The early Spanish missionaries who came to the Philippines landed in Napacahan, a sitio in Tubli and established a parish, which lasted for many years.

Early Caramoran history disclosed the fact that the town originated in Napacahan, but due to relentless and repeated Muslim piracy in the 17th to the 18th century, the town was transferred to its present site Caramoran poblacion where the Muslim pirates could not anchor because of barrier reefs.

Old people of the town of Caramoan in Camarines Sur theorized that since their town is only separated almost 2 kilometers by Maqueda Channel from Caramoran in Catanduanes, the place also abound in "cara", the turtle's precious shell made into combs, bowls and decorative articles.

The late ex-Congressman Francisco Perfecto filed the bill in congress recreating Caramoran as an independent municipality.

Caramoran is located in the northern part of the island province of Catanduanes, 86 kilometres (53 mi) from the capital town of Virac.

From Tabaco, Albay, it can be reached by chartering a small passenger/cargo motorboat direct to Caramoran, or commercial ferry services like the M/V Eugenia, Starferry, or the fast sea vessel M/V Calixta to San Andres (Calolbon).