I don't think a paint stripping chemical would damage the plaster. To be safe, I would first try it in a place where it didn't matter much.
Why do you need to strip the paint off the walls? Sounds like a mess. Can't you just scrape where the paint is loose & then spackle?
© 2016 Renovate Your World LLC