Zé Ramalho has collaborated with various major Brazilian musicians, including Vanusa, Geraldo Azevedo and Alceu Valença.

As with many musicians back in his younger days, he was first influenced by rock and roll; however, at the age of 20, his music took a more traditional Northeastern Brazilian approach.

In 1976, he left medicine school and moved to Rio de Janeiro,[4] where he searched for a record label to release his first album.

In 1979, the third son, João (born to him and to his wife Amelinha), came along the third album, A Peleja do Diabo com o Dono do Céu (also referred to as Zé Ramalho II).

In 1996, he recorded the album O Grande Encontro live with his cousin Elba Ramalho (who had already re-recorded a very successful version of his song "Chão de Giz") and the well known MPB names Alceu Valença and Geraldo Azevedo.

The record label Sony Music also released a box set containing three discs: one of rarities, one of duets and one of classics.

He also released his fourteenth studio album, Eu Sou Todos Nós, and the sixteenth one, Nação Nordestina, in which he once again explored the music of his home land, the Nordeste.

He guest appeared in the song Sinônimos ("Synonyms"), from Chitãozinho & Xororó's album, Aqui o Sistema é Bruto ("Here, the system is Brutal").

In 2009, a third cover album, Zé Ramalho Canta Luiz Gonzaga, was released, paying tribute to the Brazilian musician.

In 2012, Zé Ramalho created his own record label, Avôhai Music, through which he is releasing his first non-cover studio album since 2007: Sinais dos Tempos.

[1][2] In September 2013, Zé Ramalho performed at Rock in Rio with Brazilian thrash metal band Sepultura – the line-up was labeled as "Zépultura", a portmanteau of both artists' names.