Like - if you are on a plane moving through the sky at 500 mph and you walk from the back of the plane to the front then relative to the earth you are moving faster than 500 mph but relative to the plane you are moving at 2 mph.
Maybe similar with time travel that you remain relative to the object (earth) with which you are time traveling around?
This makes me think of a book I liked called Jumper by Stephen Gould. It was made into a movie that was also interesting. The main character had to move relative to the earth.