Built in 1854 according to a design by Cincinnati architect James Keys Wilson,[1] it was the home of New Jersey native (Wilson's uncle)[2] John S. Baker, who settled in Cincinnati in 1814.

[3] The Baker House is primarily a brick structure with some elements of weatherboarding; it rests on a stone foundation and is covered by a metal roof.

Many details produce the sense of a castle, such as its tower, its battlements and crenellations, and the decorations on the unusually placed and shaped windows.

The appearance is further improved by the house's location: sitting atop a river bluff, it is visible from a great distance.

[1] Included in the listing were two related buildings, a studio and residence for servants; they are located on the side of the bluff below the main house.