The club's fortunes rapidly improved with the appointment of Haydn Bunton, Jr. as senior coach at the end of the 1960 season, after Swan Districts had finished at the bottom of the ladder.
Castledine was moved to the centre half back position for the 1963 Grand Final and played an outstanding game once again so that the Swans were victorious.
Swan Districts finished as minor premiers by being at the top of the ladder at the end the 1965 season made it as far as the Grand Final in 1965 but lost the game in a third quarter fade out to East Fremantle.
A valuable contributor to the team and a great clubman, Fred Castledine played 162 games for Swan Districts from 1958–1969.
[5] Castledine was also a successful horse trainer, owning and training Meliador, a great WA stayer who won the 1979 Perth Cup.