You can try a solution called DIF which is used to remove wallpaper. I used it to remove some old wallpaper residue off my plaster walls and it worked nicely with a little elbow grease. I would try using it full strength and then get a good stiff brush and SCRUB! I have no idea if it will work for you, but it is worth a shot. Good luck. Let us know if this works.