He played with SønderjyskE and Randers in the Danish Superliga, before moving to the Major League Soccer in 2013 where he went on to represent Vancouver Whitecaps, D.C. United and Chicago Fire.

Ousted was brought to Randers FC in the summer of 2010 for an undisclosed fee in a swap deal with Australian goalkeeper Nathan Coe.

Ousted led Randers to a third-place finish in the 2012–13 Danish Superliga season which saw the club qualify for the 2013–14 UEFA Europa League.

In 2015 Ousted was officially named to the MLS All Star Team and started the second half of a 2–1 victory against English side Tottenham Hotspur.

[8] On 30 May 2021, Ousted won the 2020–21 Svenska Cupen, the main domestic cup, with Hammarby through a 5–4 win on penalties (0–0 after full-time) against BK Häcken in the final, where he saved Bénie Traoré's attempt.