You could probably do that, but then you've got a bigger mess if you want to redecorate in the future. You can buy a great wallpaper/border removal product called Dif at Home Depot or Lowe's. Then go to the Dif website for detailed instructions on how to use it. It is a non-toxic liquid product that you mix with water. I used it and it worked great for me. You either sponge or spray it on, let it penetrate, re-apply, let penetrate, and peel off old wallpaper. The key is to wet (not saturate to dripping) well and let it penetrate before you try to get the paper off. Use leftover product to clean residual glue from walls. Hope this helps!