Presidents Grant, Harrison, and Cleveland attended services here, as did Chester Arthur (before he took office). Built in 1868 as a Presbyterian church, it's made of the same sandstone used for B&O railroad bridges.