Tremblay ran as a Labour candidate in the district of Maisonneuve in the 1925 federal election and finished a distant third against Liberal incumbent Clément Robitaille.
He ran as a Labor candidate in the district of Maisonneuve in the 1927 provincial election and won.
He finished a distant third in the 1931 election and was defeated by Liberal candidate Charles-Joseph Arcand.
He served as Minister of Labour from 1936 until the 1939 election, when he was defeated by Liberal incumbent Joseph-Georges Caron.
Tremblay ran as a Progressive Conservative candidate in the district of Maisonneuve—Rosemont in the 1945 federal election.