At present, the terrain is on the limits of the village, and borders a cemetery and a parking lot which was constructed over part of its western outer bailey.
In its first phase Sint-Maartensdijk Castle consisted of a solitary tower house with a water well inside.
This tower might have been built on the same location as the 13th century residence of its first known owners, the Van Overbordene family.
[6] Some late thirteenth century mottes were located near Sint-Maartensdijk, and indeed contained medieval brick.
The other side was headed by Wolfert III van Borselen, and involved his clan and allies.
One of this incidents was that Knight Pieter Gherontszoon and his sons were assaulted near Scherpenisse while on their way to the court in Westkerke.
The perpetrators then crossed over the Pluimpot with the bodies, and spent the night before Pieter van Overbordene's castle.
This is no doubt related to the Van Borselen clan choosing the side of Count William V of Holland against his mother Margaret II, Countess of Hainaut.
In 1350 the first phase of the Hook and Cod wars started, and in 1351 the Van Borselens revolted and joined William.
[10] In 1354 Floris van Borselen bought the lordship of Sint-Maartensdijk from Count William V of Holland.
In 1358-1359 he held Heusden Castle for a long time against the county's regent Albert.
In 1368 Floris did without legal offspring, meaning that Sint-Maartensdijk Castle reverted to the count of Zeeland.
In 1374 he dedicated his possessions in Sint-Maartensdijk to the count, and received them back as a Hoge heerlijkheid and onversterfelijk leen.
The former meant that Frank got the high justice in his fief, meaning that he could impose capital punishment.
[10] Floris and his wife Oede van Bergen were buried in the church of Sint-Maartensdijk, where their heavily damaged tomb still stands.
Sint-Maartensdijk, Scherpenisse and his possessions in Utrecht and Brabant were inherited by his sister Alienora van Borselen.
However, Alienora survived long enough to transfer her possessions to Floris van Egmond, son of Aleid and Frederik of Egmont.
[14] Floris van Egmont (1470–1539) was count of Buren and Leerdam, Lord of IJsselstein and councilor of Charles the Bold and Maximilian I.
He was of course the rightful heir to Sint-Maartensdijk and other possessions that his mother had brought to her marriage with William the Silent.
As both Philips William and Maria did not produce any children, their half brother Maurice came next.
These were sold to the former land agent of the Oranges, Marinus de Jonge van Ellemeet.
[6] This is kind of logical, because the Oranges were almost never at Sint-Maartensdijk Castle, but the economic activity on the outer bailey continued till 1795.
In 1818 the affairs of the goods of the Oranges were finally settled, and it was decided to demolish the rest of the castle.
The buildings of the outer-bailey had to be removed till 6 feet below ground level, so that plowing would not be hindered.