I would sand the counter tops down through the poly and rough up the latex paint. Then clean thoroughly. Then apply a good primer/sealer, maybe two coats, then apply a good quality oil paint for kitchens and bathrooms. This should take care of your yellowing and have a much harder surface.
This is what I would do IF I was to ever paint a counter top, which I would never do anyway.