It's an accident waiting to happen if you don't replace it. Shut off the water until you get it replaced. Get a new wax ring too. IF you don't feel comfortable doing the replacement, then of course get someone who is.
If you decide to keep it, make sure your Homeowner's Insurance is updated to include the rider for water damage. (Just think of all the 'stuff' that can get damaged for just being out of the house for a couple of hours.)