[5] The area was initially settled by William Thomas Scott, his wife Mary Rose, and other members of their families in June 1840.

Scott's lavish plantation was said to be identical to Jefferson Davis' mansion in Mississippi, and he eventually became the largest slave owner in Harrison County.

In 1936, a historical marker was erected in Scottsville to commemorate both the founding of the community and the centennial of Texas Independence.

[7] The number of inhabitants remained steady throughout the latter half of the twentieth century in contrast to Uncertain, Texas.

[9] US 80, which forms the southern border of Scottsville, leads west into Marshall and east 11 miles (18 km) to Waskom.

Interstate 20 passes 3 miles (5 km) south of the center of Scottsville, with access from exit 624 (Farm to Market Road 2199).

According to the United States Census Bureau, Scottsville has a total area of 1.3 square miles (3.4 km2), all land.

[4] The climate in this area is characterized by hot, humid summers and generally mild to cool winters.

Public education in the city of Scottsville is provided by the Marshall Independent School District.