Use that new cement latex caulk in a tube for the crack. This way it will act like an expansion joint and shrink and expand. If you fill it with something, it will just get bigger. There should have been a bender board or tar board between the slab and the walkway for expansion.
Rust, well, you can clean it off with Naval Jelly, but to stop the problem, I would have to think on this.