He arrived in Bristol in 1800, and began to design and build unique Federal-style houses for the upper and middle class residents of that town.
[2] In 1826 Warren moved back to Rhode Island, opening an architect's office in Providence.
For a few months in 1835 and 1836, Warren worked with Alexander J. Davis in New York, who had recently left his partnership with Ithiel Town.
The Congregational Church in New Bedford was conceived under Davis at this time, but was built by Warren after he had returned to Providence.
His commissions waned in the 1850s, owing to the emergence of other architects such as Thomas A. Tefft and Alpheus C. Morse.