It is a three-story rectangular house, about 52 by 43 feet (16 m × 13 m) in plan, which William Shivers arranged to have built around 1820.

Its first floor is a high basement, built of Salmon-colored brick laid on one course of granite blocks, and topped by a narrow course of the same.

The house is late Federal in style, with "strong overtones of the Greek Revival.

As of 1970, it had only been modified significantly once, back in 1890, when an original raised portico at the main entrance was removed and replaced by a second-story porch.

The main entrance retains its original glass-panelled fanlight, wide double doors, and side lights.