He served as Chairman of the Philadelphia Democratic City Committee from 1983 to 1986 and as a member of the Pennsylvania State Senate for the 4th district from 1971 to 1981.

Smith was a sergeant and Purple Heart recipient in the United States Army during World War II from 1942 to 1945.

[4] After leaving the military, Smith became active in local politics, serving first as Ward Chair for James A. Byrne between 1965 and 1970.

[6] After redistricting in 1982, Smith narrowly lost the Democratic primary against fellow congressman Tom Foglietta.

[clarification needed] In honor of Smith's years of service to his community, the United States Postal Service facility located at 1602 Frankford Avenue in Philadelphia ("Kensington Station") was renamed as the Joseph F. Smith Post Office Building.