Sardis City started with a population of 210 residences in 1963 when the town was incorporated. The residence of the area needed water and desired to start a water board. In the process they learned that a city had to be incorporated before a water board could be appointed. On May 11, 1963 the town was incorporated with the name Sardis City.

The area had been called Sardis after Sardis Baptist Church that was founded in the late 1800s. At incorporation the town found that there was another Sardis in Alabama so city was added to the name at incorporation. On March 1, 1965 the Water Board was incorporated. In March of 1970 the Fire Department was established.