Upon completion of recruit training in San Diego, Black was assigned to the USS Maryland (BB-46) and was aboard during the attack on Pearl Harbor on 7 December 1941.

During his career, he advanced from striking for the rate of Gunner's Mate to the rank of Master Chief.

On 13 January 1967, the Secretary of the Navy announced the appointment of Master Chief Gunner's Mate (GMCM) Black as the first Senior Enlisted Advisor, the position that would evolve into Master Chief Petty Officer of the Navy.

His function was to counsel the highest ranks of the Navy on issues associated with enlisted guidance, leadership, and policy.

He was an active member of the USO Council of Central Florida; the Fleet Reserve Association; and Co-Chairman on the Secretary of Navy Committee on Retired Personnel.