Gauba was later appointed the Private Secretary (Chief of Staff) to the then Raksha Mantri (Union Defense Minister) Mr. George Fernandes.

For his keen grasp of international economics & policy issues, Gauba was selected for the prestigious post of Sr. Adviser to ED, India, IMF based in Washington.

Selection of India by IMF as member of the FTP, for the first time in 2002, sent strong signals regarding the country’s strength and resilience of its external sector to the international community.

Gauba returned to the Union Government in 2009 as Joint Secretary in the Ministry of Environment, Forest and Climate Change where he set up the National Mission on Clean Ganga.

Later as Additional Secretary in Ministry of Home Affairs (MHA), Gauba was the architect of National Action Plan to combat Left Wing Extremism which has helped to significantly contain this major internal security challenge.

This was done by removing archaic legislations like Agricultural Market Cess and Boiler Room Inspections among others, and by introducing positive changes by way of Labor Reforms.

Initial reforms in Jharkhand were viewed with skepticism yet the ethos of governance changed from a negative obstructionist approach and to a positive enabling environment.

[8][11][12] Gauba drove interventions aimed at addressing the huge infrastructure deficit in Indian cities/urban areas with focus on water supply, sewerage network and green spaces.

Gauba also led key initiatives of the Ministry, such as the preparation of the report of The High-Powered Committee On Decongesting Traffic In Delhi – which studied New Delhi’s traffic scenario in-depth and provided a four-pronged strategy for resolution – and it was under his tenure that the Ministry prepared the critical National Policy on Fecal Sludge and Septage Management.

One of the major actions to ensure these changes were implemented was the banning of Jammu Kashmir Liberation Front, which has been at the forefront of separatist activities and violence since 1988.

Gauba is credited for significantly rationalizing the weapons and equipment procurement process for Central Armed Police Forces (CPRF, BSF), removing bulging procedural layers and empowering Commandant level officers with financial powers.