The pavilion was built after World War I and owned by the Ebersen family.

On 2/1/1921 the pavilion was purchased by Peter N. Hansen and his wife Claudine whose children Erna, Art, Lorna, and Earl grew up on the resort.

Some other owners of the Swan Lake Resort over the years were a Bill and Mary Myreholt and Waldo and Marilyn Jorgensen.

Today there is a place called the Shore Store on the east side of the lake.

On June 7, 1965, an F4 tornado hit the north side, causing one fatality, with damage estimated between 500,000 and 5 million dollars.