that you are near a natural spring (several house in my neighborhood are in this situation) or you could have a leak in your water supply. Compare your water bills with neighbors, taking into account family size, lawn watering, etc. If your bill is a lot higher you could have a leak.
The only backup systems I know of are battery-powered sump pumps. Ask the inspector what he was talking about or ask the local city water company about it.