He would have to accept the deed for it to be valid. However, that would only relieve you of the requirement to pay future taxes. That would not get you off the hook for back taxes, although the most likely remedy would just be a lien on the property.
My wages are being garnished for back taxes on property my ex-husband has been occupying for the last three years. My name is still on the property. If I file a quit claim deed - will he be soley responsible for the back taxes? He is making no effort to help me pay HIS property tax!