It is located 3 miles (5 km) east of Norwich, on the south bank of the River Yare, reached from Trowse along Whitlingham Lane.

There is photographic evidence to suggest the ruins were prettified during the second half of the 19th century, with eroded parapets rebuilt, and new window tracery inserted.

[citation needed] Gravel from Whitlingham was used on construction projects in the city such as the Castle Mall, The Forum, and the redevelopment of the old Nestlé site into the Chapelfield shopping centre.

Norfolk County Council leases the Great Broad from the Crown Point Estate which is represented by the Whitlingham Charitable Trust.

[6] The Broads Authority is planning to bring in byelaws to make swimming illegal, except in organised groups run through the Whitlingham Adventure Centre.