He was the first-born son of Robert Patrick Baffour Andoh and Maria Frederica Adwoa Kane (Okai).
His paternal grandfather was the illustrious Chief Kweku Andoh of Elmina who served in Sir Garnet Wolseley's military campaign against Prempeh I, King of the Ashanti.
Baffour's paternal grandmother was the eldest daughter of Yaa Na Yakubu I of the Dagomba tribe named Napari.
His maternal grandfather was Chief Nii Kofi Okai of the Gbese quarter, Accra, who was commonly known as Joseph H. Kane.
[3][4] When Baffour worked at the Accra City Council, he was involved in automobile design, specifically the 'Ewurakua' and 'King Kong' cars.
[3][4] He was the instigator of the Kwabenya Nuclear Plant project that was halted, six months from completion, by the military coup against Kwame Nkrumah.
In 1962, Baffour was elected president of the 6th regular session of the General Conference of the International Atomic Energy Agency (IAEA).
[3][4] An aficionado of the arts, he was involved in film-making, particularly, “A Day in the life of an African” produced by the British Broadcasting Corporation as well as “Progress in Kojokrom” ( a film which was exhibited throughout the Gold Coast.
[3][4] His son, Fritz Baffour, a journalist and communication consultant served a Member of Parliament from 2009 to 2016 and the Minister for Information in 2012 under the National Democratic Congress.