The reason being is that if something happens it is because it already happened. If you could time travel it wouldn't matter what direction you traveled in because all time exists concurrently. Everything that can happen has already happened so your traveling in time doesn't change anything, it already occurred before you did it, after you did it, and while you're doing it.