Use a window unit air conditioner cover in the winter to keep out cold air. Air conditioner covers protect the window unit from the weather and damage when not in use. Pool covers at In The Swim.