there's a neural to retinal delay. by the time the retinal information reaches the higher regions either the world or the observer's position has changed.