On 3 April 1964 he married Irene Earsman of Castle Douglas, Galloway, Scotland, and they went on to have two sons and one daughter.

He had one further spell in employment outside of Westminster politics when he lost office in 1992, as the Development Manager of ATB-Landbase Cymru from 1993 to 1997.

When he returned to Wales he became active in the Welsh Liberal Party and stood unsuccessfully for Pembroke in 1979 and Brecon and Radnor in 1983.

Livsey had been a keen supporter and activist during the 1979 St David's Day referendum on a Welsh Assembly on behalf of the Yes Campaign.

Livsey joined a group of three Welsh Liberal MPs (the others being his friend and mentor Geraint Howells, and Alex Carlile).

Livsey was appointed a Commander of the Order of the British Empire (CBE) in the 1994 Birthday Honours.