Owing to the size of the Lin family clan, the vast site can be divided into two sections, the Upper (頂厝) and Lower (下厝) Mansions.

In 1863, Lin Wenqin, having passed the County Examination, constructed Laiyuan on the foothills of Wufeng, and offered performances for the diversion of his mother, Madame Luo (羅太夫人).

The name of the gardens derives from the story of the filial Old Master Lai (老萊子), who even after reaching 70 years of age, would still dress in gaudy clothing and entertain his elderly parents (彩衣娛親).

Laiyuan now serves as the campus of Taichung Ming Tai High School (臺中市私立明台高級中學).

The Lin Family Residence, after having suffered through the 921 earthquake, was under the financial support of the Executive Yuan's 921 Rebuilding Committee (行政院九二一重建委員會), the Taichung County Cultural Bureau (already in conjunction with the Taichung Municipal Cultural Bureau) are currently finished with restoration and reconstructive work in five areas, respectively the Upper House's Tower of Prospective Fragrance (work completed) and Nourishment Orchard (already open), and the Lower House's Large Flower Hall (work completed), Residence of the Palace Guard (work completed), and the Two-roomed House (work completed).