Olivet Fourth Congregational Church is at 33 Oak Street and is from 1912. The Fourth Congregational Church is from 1833. The church was once on the Armory grounds on State Street. Luther Cone was the pastor from 1867 to 1898. The Dunbar Community Center held space here from the 1930s onward.
Nowadays the Mount Zion Baptist Church is there.
