Can you imagine if he had just managed to miss it though? He pops in about three weeks after it has happened to check that Torchwood isn't doing anything too stupid and maybe (as I saw in one fic) release the Weevils or because he has noticed that the Rift is doing something funny and then he finds the crater where Torchwood was...

And of course you can't cross your own timeline or something...