During the American Revolutionary War this house served as the headquarters of the Comte de Rochambeau, commander of the French forces stationed in Newport 1780–1783.

The house is named after William Vernon, prominent slave trader and figure of the American Revolution, who purchased the home in 1773.

The doorway is flanked by fluted pilasters and topped by an entablature and modillioned cornice, a treatment repeated in simpler form on the secondary entry at the rear.

The plasterwork in the northwest room feature a period mural, depicting the Chinese court punishments and the Buddhist cycle of hell.

[5] Most of the building's appearance is due to an extensive alteration to an older structure in 1759, and represents the finest rendition of academic Georgian architecture in the city.

When French forces arrived at Newport in 1780 during the American Revolutionary War, Vernon offered his house to their commander, the Comte de Rochambeau.