After the split with Dr. Clapp, the Presbyterian members met in a warehouse located on Lafayette Square, and duly formed a committee "for the purpose of building a New Presbyterian Church in this city" and purchased the warehouse where they had been meeting. Construction of the new Greek Revival style was completed in 1835. The 1838 city directory described it as an edifice of the Grecian Doric order. The basement story of granite, the rest constructed of brick plastered to imitate stone (already discolored and in need of repair). In 1844 the church was considerably enlarged. A few weeks later it burned to the ground, "beyond all doubt the work of some villainous incendiary..."
The congregation was without a pastor or building for over 2 years.