Algorithms to Live By: The Computer Science of Human Decisions

by Brian Christian

The Gittins index, then, provides a formal, rigorous justification for preferring the unknown, provided we have some opportunity to exploit the results of what we learn from exploring.