All-Hallows-by-the-Tower is just down the road from (and provides elevated views over) the Tower of London. When the first church was built here in the 7th century, the site had already been in use for several centuries. You can see Roman, Saxon, and medieval remains at its small museum.