Algorithms to Live By: The Computer Science of Human Decisions

by Brian Christian

Gittins, for his part, made the assumption that the value assigned to payoffs decreases geometrically: that is, each restaurant visit you make is worth a constant fraction of the last one.