The historic Brandon Baptist Church has been a town landmark since the early 1800s. The Baptist congregation was established about the time of Brandon's settlement in the late 1700s. The early worshippers met first in a log meeting house and later in a larger frame church. John Conant, a church deacon and prominent Brandon businessman, financed and supervised construction of the present building in 1832.

The original interior was different than it appears today. Balconies adorned the sides and rear of the sanctuary, the pews were enclosed, and the minister preached from a high, raised pulpit reached by a winding staircase.

On November 26, 1950, a powerful hurricane toppled the steeple. Crashing through the roof, the steeple drove like a spear through the main sanctuary, causing extensive damage. The cost of replacing the spire was prohibitive and the building remained without one for 50 years. In 2000, a group of local citizens raised money for a new steeple and the church was restored to its original appearance.