He established several pastoral properties and was a co-founder of what became Elders Limited, also serving two terms in the South Australian Legislative Council.

Stirling was born in Jamaica, the illegitimate child of a Scottish planter and a Jamaican woman of colour; his mixed-race ancestry was not public knowledge.

[4] After moving to South Australia he identified solely as Scottish,[5] but his mixed-race origin was passed down through oral history accounts which suggest his mother was a Creole woman named Jeanne or Jeannie.

He finished school at about the age of 17 or 18 and was then employed as a clerk in Glasgow by the merchant firm of Alexander and John Dennistoun, associates of his father.

His cousin Charles accompanied him, while their respective brothers remained in Scotland and received annuities in Stirling's father's will.

In that year they moved 3,000 sheep south-east to Rivoli Bay, a distance of 180 miles (290 km), but two-thirds of the flock died of coast disease within a few months and the cousins suffered financially.

[8] In 1853, Stirling and his cousin further expanded Hampden to its largest size of 1,129 acres (457 ha) and established another property, Highland Valley, nearby.

In 1860 he took over land near Whyalla (SA) now known as Point Lowly from James Chambers and "while he was in occupation he liberated a few pairs of rabbits to breed for sporting purposes.

In 1865 he and Harriett, with their two sons John and Archibald and three daughters, returned to England, where Edward joined the London Court of Directors, of which he was chairman at the time of his death.

[15] In 1864, Stirling moved his family to England for his sons' education, joining the South Australian Banking Company's court of directors in London.