I would try a product called Goof Off. It removes about anything. It will remove the paint from the wall too, but sounds like you're planning on repainting anyways. Then, before you repaint, spot prime the area so your top coat will stick.
© 2016 Renovate Your World LLC