Rugg was born on August 20, 1862, in the town of Sterling, Massachusetts.
[1] Immediately after admittance, Rugg established his practice in Worcester, Massachusetts, with John R. Thayer.
During this time, Rugg was involved in a number of political organizations.
He was a member of the Worcester city council in 1894 and was president of the group the next year.
They had three children: sons Charles Belcher and Arthur Prentice Jr. and daughter Sidney H.