Throughout its existence in the Caribbean Sea, the hurricane damaged, destroyed, and capsized numerous ships, and at Saint Kitts, it was considered to be the worst since 1772.

Strong winds and heavy rainfall inundated streets, residences, and fields, and also toppled chimneys, fences, and cracked windows across the region.

[5] Little information exists on the hurricane's whereabouts between North Carolina and New England, with a single report at Norfolk, Virginia of east-northeasterly winds veering east-to-east-southeast from 7 to 9 September, suggesting the disturbance's passage west of there.

Betsy was stripped of its freight and somewhat damaged, Phoebe ran aground at Tybee Island,[3] Liberty perished with its crew killed, Patsy nearly sank, and Experiment capsized.

At the time the hurricane struck, Aaron Burr, hiding from federal officials, was taking refuge at St. Simons Island on the property of John Couper, though was unable to return to Hampton due to deteriorating conditions.

[4] In an account of the hurricane, Burr recorded strong winds, which destroyed several outhouses and uprooted numerous trees at St. Simon's, with the storm later cracking windows, toppling chimneys, and flooding the house; in the town proper, he discovered many local roads were obstructed.

At Sunbury, intense winds and high waves uprooted trees and wrecked three houses, of which two were newly built, and five slaves died after being impaled by flying wreckage or drowning.

The hurricane also ruined most boats under the possession of plantation owners, and also devastated crops, storage houses, stables, and slave residences.

[11] North-to-northeast winds surrounded Hutchinson Island, producing tides 7 to 10 ft (2.1 to 3.0 m) above normal, submerging rice crops, sweeping away plantation buildings, and drowning nearly a hundred slaves.

The hurricane's storm surge overcame sand bars, sweeping into bays, rivers, wharves, and any areas below an elevation of 10 ft (3.0 m).

Droplets of sea spray mixed with rain, apparently giving it a saline taste, while particles of sand were lifted from the shore to the upper floors of 30 ft (9.1 m)-tall houses.

Many smaller vessels were apparently "cracked like egg shells," floating in waters paralleling the bluff, which itself was strewn with "serpents, turtles, [and] marsh-birds".

From Sheldon to Motley, the storm flooded creeks and rivers, inundating rice and cotton fields, with the saline water destroying the year's harvest.

[18] A rice harvest equivalent to ten thousand barrels was ruined by high tides and torrential rain within the vicinity of Georgetown.

[19] At Saint Kitts, the hurricane destroyed approximately one hundred ships in the local harbor—all that were stationed there—while heavy rainfall drove houses to sea.

[2] Although high waves and severe northeasterly gusts were noted from 6 to 7 September 1804 at St. Augustine, Florida and eight of the nine vessels in the local port were rendered unfit for use, the town proper largely escaped damage.

[2] In North Carolina, the hurricane blew down trees as far as 100 mi (160 km) inland,[6] and copious rainfall isolated Scotland Neck.

[6] In the New England gale possibly related to the Antigua–Charleston hurricane, several ships sank in Boston's harbor, while at Salem, the South Church's steeple was toppled.