Ulmer graduated from Princeton University in 1939 and joined the United States Navy prior to the start of World War II, ultimately becoming a major head of intelligence operations during World War II.
He married Doris Gibson Bridges and had three sons (Alfred III, James and Nicolas) and a daughter (Marguerite).
He then joined the Office of Strategic Services (OSS) in 1945 and oversaw operatives gathering information in Turkey, Egypt, Italy and Austria.
When the OSS was disbanded in 1945, Ulmer became head of the Strategic Services Unit (SSU) in Austria.
Although the SSU lacked the personnel to effectively carry out covert operations, Ulmer pushed for more money and was finally rewarded by a $150,000 annual budget.