Sylvester Brown took up whaling and built a stone mansion, Enmore, which gave its name to the suburb of Sydney.
One of Browne's closest school friends was a son of Colonel John George Nathaniel Gibbes, MLC, the Collector of Customs for New South Wales, and according to the Dulhunty Papers, Browne spent carefree holidays staying with the Gibbes family at their grand waterside residence on Sydney's Point Piper.
He visited England in 1860 and in 1862–1863 had a property, Murrabit run at Lake Boga near Swan Hill, followed by Bundidgaree station on the Murrumbidgee River near Narrandera in the Riverina in 1864.
After living in Sydney a short time, in April 1871 he was appointed a police magistrate at Gulgong and gold commissioner in 1872.
Its editor Thomas Frederic De Courcy Browne was thereupon convicted in Sydney of criminal libel and sentenced to six months gaol.
The charges against Browne were disproved, and he won favour with the miners by magnanimously interceding with the judge for a light punishment of his libeller.
He moved to Albury as chairman of the Land Licensing Board in 1885, serving there as magistrate and warden from 1887 to 1895 until retiring to Melbourne.
The name Boldrewood came from a line in the poem Marmion by Browne's favourite author, Sir Walter Scott.
Some of the events in the book are based on actual incidents carried out by contemporary bushrangers like Daniel Morgan, Ben Hall, Frank Gardiner, James Alpin McPherson and John Gilbert.