We have the same problem. A couple times a year, I go out after the sun sets with a couple cans of bee/wasp killer and spray into the louvers. The cans have enough power to get the second floor shutters if needed. I attack only the shutters known to have bee's. I don't know of any way to prevent them from starting the nests.