Saint Peter Church is on 24 State Street in Westfield. The church is from 1916. A new parish was formed in 2016 with the Saint Peter and the Saint Casimir Parishes. The Slovak ethnic group of Westfield wanted its own parish and they formed one within the Saint Mary Church in 1909.