Algorithms to Live By: The Computer Science of Human Decisions

by Brian Christian

Unlike previous researchers, Gittins approached the multi-armed bandit problem in those terms. He conceived the goal as maximizing payoffs not for a fixed interval of time, but for a future that is endless yet discounted.