Caffeine is removed from your system by an enzyme within your liver,fn8 which gradually degrades it over time. Based in large part on genetics,fn9 some people have a more efficient version of the enzyme that degrades caffeine, allowing the liver to rapidly clear it from the bloodstream.