Purchase a grout saw and cut completely through the grout joints surrounding the problem area. Then "go to town" so to speak with a chisel and hammer. See Tile Removal for more info.
By the way a pre-grout release similiar to SURFACEGARD™ SEALER will make your next grout job a whole lot easier without having to use grout damaging acids.
© 2017 Renovate Your World LLC