Educated at Westminster School and Christ Church, Oxford, Cotton inherited his title from his father when he was ten years old.

Although his father, grandfather, godfather, uncle and brother-in-law were admirals, and he was named after a naval battle, Cotton decided to join the army.

He drove a London to Brighton stagecoach at one time, and was also a deputy lieutenant, militia captain, and magistrate for Cambridgeshire.

[4] Although he came from a naval family, Cotton was happier on horseback or driving horses and decided to join a cavalry regiment, the 10th Hussars or Light Dragoons.

[2] On occasion he was involved in brawls and was once quoted as advising brawlers to "pitch into the big rosy men, but if you see a little lemon-faced nine-stone man, have nothing to do with him".

Contrary to what is sometimes said, the Madingley estate had not been completely gambled away, and went to Cotton's sister Maria who was married to Admiral Sir Richard King.

[2] His mother and sisters remained loyal to him through thick and thin, and his nephews enquired after "dear Uncle Vinney" when writing home from the Crimea War.