If you start at Save #3, the buttons above ground at Villa Jovis have all been pushed correctly.
Just go to the blue whirlpool door that is the entrance to to the catacombs and go from there.

Just continue at Villa Jovis catacomb as far as the walkthrough states and go from there.
The time machine is still in your inventory and you have to go through the church later.