Eye-tracking studies have shown that your eyes actually quiver and move around considerably. These are called saccades. And every movement away from your position in text requires a few milliseconds to readjust and refocus. All of these minuscule readjustments in locating your place in a book add up to be very costly to your reading speed.

