Algorithms to Live By: The Computer Science of Human Decisions

by Brian Christian

the probabilities of a payoff on the different arms change over time—what has been termed a “restless bandit”—the problem becomes much harder.