A carpet knife can work well for cutting away old caulking from house siding. Slice down alongside it from both directions with the hook-like blade, then use the knife to lift out the old caulk bead intact.
If deer are hungry enough, they will eat almost any plant. However, some plants are less appealing than others, depending on what your local population has learned to eat so far. Daffodils are often cited as being deerproof, along with glory-of-the-snow (Chionodoxa) and crocus. Unfortunately, tulips and lilies are deer favorites. You might ask some of your neighbors if they have had luck with any particular plants, then try those in small quantities as an experiment. Many gardeners use repellent sprays with varying success, but to be as effective as possible they must be applied and reapplied according to the instructions. Home remedies include using soap, blood meal, human hair, and so on, but in the end the only truly reliable solution is a deer-proof fence.