[1] The fort had a succession of Muslim rulers (Khaljis, Tughlaqs, Lodis, Nawabs of Bengal, followed by Mughal rulers, till it was finally acceded to the British by Mir Quasim (1760–72), after unseating his father-in-law Mīr Jafar on the grounds of old age, for a monetary reward negotiated by Vansittart.

[2][3][4][5] The fort houses a number of religious and historic monuments such as the Tomb of Pir Shah Nufa (died 1497), Palace of Shah Suja, Tomb of Mulla Muhammad Said (died 1704 CE), the Kashtaharini Ghat on the Ganges River, Chandisthana (an ancient temple) and an 18th-century British cemetery.

[1][5] The etymology of the word Munger prefixed to the fort and to the town also called by the same name is Mudgagiri with links to the Mahbharata epic.

But its ancient history, as a town, mostly ruled by Hindu kings, is initially traced from a stone inscription to Chandragupta (4th century CE), (after whom it was initially called Gupta Garhis) and later dated to the kingdom of Anga, the capital of which was at Champa near Bhagalpur, and the Pala kings in the 9th century AD.

It is also stated that Prince Danyal of Bengal built the shrine of Sufi saint Shah Nafah within the south gate of the fort, in 1497 AD.

[6][7] In 1590, the importance of the fort was enhanced by making it the headquarters of Bihar army of the rulers of Gaur under their general named Kutub Khan.

Raja Todar Mal, Minister in the Mughal empire had camped at this fort when he was deputed to put down the rebel forces of Bengal.

He was made governor of the region after protracted negotiations with his brothers Dara Shikoh, Murad and Aurangzeb, and under the treaty of 1658 Munger was added to Shuja's reign.

Jean Law, the French adventurer and partisan of Siraj ud-Daulah (1733 – 2 July 1757), the last independent Nawab of Bengal, Bihar and Orissa was running away after the Battle of Plassey.

[5][7] In February 1760, Major Caillaud of the Nawab of Bengal and his supporters defeated the Mughal Emperor Shah Alam II (1728–1806).

His new appointee General Gurgin Khan from Isfahan patterned the Bengal Army on the lines of the British forces.

Mir Quasim came to be known as a just ruler (he tried to eliminate corruption and injustice) but was also feared by his opponents as a fierce and ruthless warrior.

The mutiny broke out over the reduction of an extra monthly payment called bhatta to soldiers on active duty.

The fort was an impressive structure with massive gates, one of which had been a strong fortification with square towers, with a deep moat.

It opens to the Ganges river (which is 2 kilometres (1.2 mi) wide here, but crossed only by boats) at either end thus enhancing the fort's security.

[1][11][12] The fort is spread over an area of 222 acres (90 ha) over rocky hills with a peripheral length of2.5 miles (4.0 km).

The carved stones of these ancient ruins were pitted by holes and depressions, with the belief that such disfiguring would cure certain diseases of children.

The domed tomb chamber, 16 feet (4.9 m) square with circular turrets, also encloses a prayer room and a restroom.

[1] Though locally known as the 'Palace of Shuja', the Mughal Prince, it is inferred to have been built earlier by Nawab Mir Qasim Ali, who also ruled from Munger.

An interesting feature noted below the floor of the mosque is a dry well or pit of 10–12 feet (3.0–3.7 m) depth, which leads to several tunnels running in different directions.

The Khas Mahal of the palace and the Public Audience Hall inside the fort, which are now seen mostly in ruins, are used as a jail and a school for the convicts.

At this location, a ghat (stepped approach to the river edge from the high bank built in stones) was constructed, which has a legend linked to it.

There are several antiquities that have been unearthed at this ghat such as: an inscription of about the 10th century AD on the wall of the gateway that refers to king Bhagiratha and the construction of a Shiva temple; discovery of carvings and sculptures by archaeologist Bloch in 1903; an inscribed image of Dhyani Buddha (Buddha in meditation pose) describing the Buddhist doctrine; preserved now in the Indian Museum at Kolkata).

Since the location commands a fine view of the surroundings, Raja Karan (he was a contemporary of Vikramaditya, the famous king of India) had built a house on the hill, which was later converted by the British to a saluting battery.

Further refurbishing of the fort occurred during General Goddard's time when it was converted as the large residence (as it exists now) of the Commanding Officer of the British garrison.

In addition, in a well in the compound of the bungalow, two arched passages were found; one lead to the house and the other in an opposite direction to the Shuja palace (now a prison).

Apart from providing spiritual instruction to candidates, the school undertakes yoga projects and medical research in association with other agencies.