In other words, there is a cognitive switching cost to shifting your attention from one task to another. When your attention is shifted, there is a residue of it that remains with the prior task and impairs your cognitive performance on the new task.

