I recommend CLR Calcium-lime-rust remover! We had rust like stains on our siding in MN. It takes a little elbow grease. If it does not work right away, try not cutting it with water like it recommends. It did not damage our paint at all. Maybe try it behind a bush to be safe at first? But we had no problems! Good luck.