At different times, both Pat Morris Neff and Sam Rayburn lived in the residence when Mrs. Wahrenberger ran it as a boarding house.

Originally a two-story limestone residence when it was built in 1867–68, this house erected by Friedrich Huster has undergone a few changes.

[3] In 1880, Klein leased the premises to Jacob Bickler, founder of the Texas German and English Academy.

He later moved the academy to the larger Texas Military Institute Castle in Austin, but Bickler himself retained the lease on the house until 1886.

Her husband, local businessman John Wahrenberger,[7] died in 1864, leaving Caroline with four children to support.