stars or otherwise stationary lights in the night sky is called visual autokinesis. Basically if you stare at a star long enough it will start to appear to move. This illusion usually only happens if you stare constantly at it without moving your eyes around and scanning other parts of the sky.

I only bring this up because I’ve had it happen to me before when trying to figure out of what I’m looking at is a star or satellite. Not sure what you were seeing in your case.