After abandoning his studies, he came to Bombay and started his career in cinema with the silent film Fatal Garland (1928) opposite the top actress of the time, Ermeline.

During his stint in silent films he worked with directors such as Bhagwati Prasad Mishra, Ezra Mir, Moti P. Bhagnani, R. S. Chowdhary, and M. D.

[3] Magazines in the 1940s compared Khan to Hollywood actors such as Paul Muni, Bela Lugosi and Boris Karloff.

Following his father's wishes, he studied law but soon left that to move to Bombay and pursue a career in film.

His tenure with the police trained him in horse riding and other "athletic abilities", which were proved helpful to him in his cinematic career.

[3] His other films from 1926-1931 during the silent era include Durgesh Nandini (1926), Hoor-E-Baghdad (1928), Vasl Ni Raat, Be Dhaari Talwar (1929), Ram Rahim (1930), Hamara Hindustan (1930), Sinbad the Sailor (1930), Raj Tilak (1931) and Golibar (1931).

Durgesh Nandini was directed by B. P. Mishra for Sudarshan Films and starred Ermeline and Madanrai Vakil.

With the trend shifting to "mythological, historical and semi-social", he performed roles that required "a touch of extra realism".

The film is stated to be a "part of Imperial's calculated and successful effort to manufacture a star image for the actress (Sulochana)".

1929 had five films starring Khan, variously directed by Mishra, Bhavnani and Altekar, with the production company remaining Imperial.

In 1932 he acted with actor-singer K. L. Saigal and Kumar in Subah Ka Sitara produced by New Theatres Ltd., Calcutta, and directed by Premankur Atorthy.

[14] Ek Din Ka Badshah (English: King For A Day) was again directed by Rajhans and had Sabita Devi, Indubala, and Bachan as co-stars.

Aurat Ka Pyar (English: A Woman's Love) was directed by A. R. Kardar and starred Gul Hamid, Mukhtar Begum, Anwaribai and Bachan.

1936 had Khan enacting a significant role along with Gul Hamid in Baghi Sipahi, an adaptation of Cardinal Richelieu (1935).

[19] In 1939, Khan acted in the film Aap Ki Marzi, directed by Sarvottam Badami, and co-starring Sabita Devi and Motilal.

[20] In 1940, Khan played an important role in Achhut, a film made to "promote Gandhi's movement against untouchability".

[9] He directed his first film in 1942, called Meri Duniya on Hindu-Muslim unity, for National Artists, Bombay.

Khan married Bollywood actress Zeenat Aman, who was Hindu, and who did not convert to Islam after marriage; they later separated.