[1][2] Orta had leased the island of Bombay from the King of Portugal between 1554 and 1570.

Over the next ten years, they built a defensive structure around the manor.

The castle had four Bastions, three of which were originally surrounded completely with water.

A sundial thought to date back to the Portuguese era is also present.

The residence was later moved to Parel and then to Malabar Hill over the next two centuries.