... As Steve says, you've turned a maintenance-free paver into one that now requires maintenance. What you'll find is that the sealer wears off quicker where you 'step' vs. where you don't usually step. In short, the wearing is NOT even.
If you go this route, you'll be Posting on the Forum wondering how to 'undo' this project. Just washing with a power washer (if it won't blow out your grout) will keep the pavers clean. Or, a solution of 1/4 cup bleach to 1 gallon of water, along with a soft/medium bristle broom/brush will clean them well.