He next worked under Thomas Lipson, the first harbourmaster, as one of five crewing the pilot boat Mary Ann under Hugh Quinn.
In 1842 he moved to American River, Kangaroo Island, fishing, farming, harvesting salt and trading with Adelaide on Petrel.
And while there, he built the larger ketch Kangaroo with John Buick, considered the "father" of American River.
In 1849 Frank, with William Carter and George Mason, built a ferry for crossing the Murray at Wellington.
Augusta's father and three of her brothers, who had made some money at the Bendigo goldfields, took up land at Langhorne Creek, as did Henry Ayers, George Mayo, John Ridley, and many others who later had a part in the Potts family history.
As his sons grew to adulthood, Frank was able to leave work on the vineyard, winery and stills to them, and put his energy into his first love – boatbuilding.
The paddle steamers Wilcannia (1875) for Captain Tinks (died 1889) of Milang and Bourke (1876) for Albert Landseer, several barges, a punt for James Rankine (for the crossing known today as Rankines Ferry), and some eight sailing boats, which were used to carry wheat across Lake Alexandrina to Goolwa.
He built the fast yacht Pasquin for Allan McFarlane of Wellington, then the Beltana, which proved even faster.
Frank had an older sister Anne (28 November 1812 – 14 August 1881) who married Henry Ayers at Alverstoke on 14 June 1840.