From 1963 to 1965 he was county captain, and in his first year, with the side buoyed by the newly acquired Brian Bolus, Nottinghamshire finished ninth.

Two years later, though, they were back at the bottom and Millman resigned the captaincy and left first-class cricket, returning to Bedfordshire and his business interests.

In 1961–62, Marylebone Cricket Club (MCC) sent a somewhat unbalanced side, strong in batting but rather weak in bowling, on a four-month tour of India, Pakistan and Sri Lanka, then called Ceylon.

He made enough of an impression to be picked for the first two home Tests against Pakistan in the 1962 season, before giving way to Murray for the rest of the series.

Murray and Alan Smith were then picked for the 1962–63 Marylebone Cricket Club (MCC) tour of Australia and New Zealand, and Millman's chance never came again.