Later that year, Wohlforth and a minority of ISL members joined the Socialist Workers Party (SWP), which was the main Trotskyist group in the US at the time.
They were expelled in 1964 after demanding a discussion of the significance of the Sri Lankan Lanka Sama Samaja Party's entry into the government of Mrs. Sirimavo Bandaranaike.
An investigation conducted by the Workers League concluded that Fields did not have connections to the CIA, and the two were requested to resume their membership.
[4] Wohlforth later claimed that the Workers League became a cult, largely due to the domination and manipulations of the principal ICFI leader at the time, Gerry Healy.
His former wife Nancy Wohlforth, is Secretary-Treasurer of the Office and Professional Employees International Union (OPEIU) and on the Executive Committee of the AFL-CIO.