Welcome, First Time Dolly. There are a couple of things that you can try first, but you must be extremely careful about using them around sources of ignition like gas stoves/waterheaters, and electric motors including fan motors. I would try Goof Off first. This is available in most home centers. Mineral spirits is similar but you might try this too. I don't think that Citristrip would be the first choice, but you might give it a try if the others don't seem to work.
I would not be too concerned about using a putty knife or scraper to get it off since you are going to sand the floor anyway. Just don't put in any deep gouges.
Don't forget your gloves and eye protection when using any chemical and open all the windows if you are using the Goof Off or mineral spirits. Let us know what works best on your floor.