First, it sounds like your home has HIGH humidity. With that, you need to determine the souces (yes, sources ...) of the humidity. Many people taking LOOOOONG showers, boiling water a lot, poor air circulation / undersized HVAC, tight house (yes), clothes dryer being vented into the living space / basement, new ventless stove, fireplace, etc., etc.. Once you've evaluated that, you have 2 choices - 1) Modify / Alter the 'activities' that cause the moisture, or change them, or 2) get a dehumidifier.
As you can see, turning on the fan improves the situation, although slightly. THis talks about improving air flow. Opening doors/windows improves the situation too, although slightly. This talks about dehumidification (of sorts, by mixing dry air from outside w/the dry air inside the house.) Heavy frost outside isn't related. What's related is the temp. differential between the outside AND the inside.
If you have a portable dehumidifier and a fan or 2, or if you can borrow them, set them up in the room that has the most problems. See if the situation changes. If it does, see what you can do about improving the airflow and getting a true dehumidification system.