Removing a granite backsplash is a delicate operation that demands patience and the right technique. The primary goal is to separate the stone from the wall without transferring that force to the drywall behind it. Drywall is relatively fragile and will crack or crumble if you pry directly against it. By focusing on the adhesive or mortar and using the proper tools, you can preserve the wall surface for a clean reinstallation or a fresh finish.
Assessing the Current Installation
Before touching a tool, you must determine how the granite is attached. Older installations often rely on a thick mortar bed, while modern ones typically use a polymer-modified thinset adhesive. Mortar creates a rigid bond that requires mechanical breaking, whereas thinset is more like a putty that can be slowly dissolved or scraped. You should also check for expansion gaps; if you find flexible, compressed foam at the edges, the installer intended for the stone to move, which means you need to be extra cautious to avoid cracking.
Tools You Will Need
- Safety goggles and work gloves
- Putty knives and chisels (metal and plastic)
- Grinding tool or rotary hammer with chisel attachment
- Heat gun or hair dryer
- Adhesive remover or citrus-based cleaner
- Rubber mallet
- Hammer drill (for stubborn mortar)
Breaking the Seal and Initial Removal
Start at a corner or an edge where the seam is visible. Insert a putty knife or a flat chisel between the granite and the wall. Gently tap the handle with a rubber mallet to wedge the tool deeper without forcing the stone. Your aim is to break the bond at the perimeter. Once you create a small gap, insert a heat gun to soften the adhesive if it seems particularly tough. The heat disrupts the polymers in the thinset, making the removal process significantly easier and reducing the risk of damaging the drywall.

Systematic Scraping Technique
Work in sections no larger than a square foot at a time. Slide a wide putty knife horizontally along the backer board of the granite to lift the stone slightly. Do not try to pry the slab up; instead, focus on sliding the tool behind the material to shear the adhesive. If you encounter resistance, switch to a stiff metal scraper for the thick adhesive, then finish with a plastic edge to protect the drywall paper face. Continuously check the wall surface; if you see deep scratches or gouges, switch to a softer tool immediately to prevent marring the finish.
Dealing with Mortar and Stubborn Residue
If the backsplash was set in mortar rather than adhesive, the removal process changes from scraping to localized breaking. Use a rotary hammer with a chisel attachment to gently fracture the stone into manageable pieces. The goal is to remove the stone in large chunks rather than small fragments, which minimizes the vibration that travels into the drywall. For the residual mortar left on the wall, avoid heavy grinding directly on the gypsum board. Instead, use a hammer drill with a masonry bit to create small holes in the hardened mortar, allowing a putty knife to slip behind the residue and lift it off in sheets.
Cleaning the Wall Surface
Once the stone is off, you will likely be left with a patchwork of adhesive and possibly thinset. A standard solvent isn't always effective on stone, so you need a targeted approach. Apply a citrus-based adhesive remover to a cloth and let it sit on the sticky spots for 15 to 20 minutes. This chemical break down the polymers without harming the drywall. Use a plastic putty knife to scrape away the residue, wiping the blade clean frequently. For any fine dust or haze, a mild soap solution and a sponge will sanitize the surface without saturating the drywall, which could lead to mold or warping.

Inspecting for Damage and Final Steps
With the backsplash cleared, you can finally inspect the drywall for any hidden stress. Look for areas where the paper face has bubbled or the gypsum core has cracked. Minor cracks can be repaired with joint compound, but significant crumbling may require replacing the entire board. Assuming the wall is intact, you are now ready to prepare for the new installation. Ensure the surface is perfectly smooth and dry, and consider applying a bonding agent if you are applying a new tile directly over the old drywall to ensure a durable bond.