[3] The Kayser house is 2.5 stories, with a footprint roughly rectangular and a hip roof flared above the eaves.

Beneath the porch, the front door is flanked by four Ionic columns, and beyond that, two shallow bays with the outer windows decorated with a flat stone lintel.

Above the porch, a centered three-part window is separated by unusual columns, which point to the large arch-fronted dormers that rise from the roof.

Inside the front door, a central hall leads to shared rooms on the first floor.

Then in 1922 they built a new house in the then-popular Colonial Revival style a short distance away at 425 N. Livingston St.[4] Their 1902 was listed on the National Register of Historic Places in 1980 and on the State Register of Historic Places in 1989,[5] noting that "it represents a fine example of a large residence designed by an important regional architectural firm, Claude and Starck of Madison, Wisconsin, in the 'progressive' manner emerging in the Midwest as opposed to the traditional revival types of architecture.