In 1975 The Colleton Historical Society received a grant for the complete restoration of the Little Library, originally constructed about 1820.

In 1977 a separate organization The Walterboro Preservation Society was established to promote the protection of historic buildings and houses. This organization established two historic districts which in 1980 were placed on the National Register of Historic Places. Shortly after this, these two organizations merged to become The Colleton County Historical and Preservation Society.

In 1984 The Colleton County Historical and Preservation Society was instrumental in placing the sundial and planter on the grounds of the Little Library to commemorate Walterboro's Bicentennial.

In 1988 The Colleton County Historical and Preservation Society opened the Colleton Museum, and restored the Old Jail for this project.