Can you describe how the window is flashed and attached to the house? I would be inclined to remove the old storms, but you certainly want to be sure the window installation is water-tight.
You say the window slides in between teh back stopper. What is the back stopper? Did you remove the old jambs and sill?
© 2016 Renovate Your World LLC