I have never heard of a properly installed sump pump causing a problem as you describe.
What can happen in floods, if basements are full of water and then are pumped out too rapidly using a pump which is much, much bigger than a standard sump pump is the walls can cave in due to the rapid change in pressure. This is not your case.
Where did you read this?
If it were me, I would not remove it.