Algorithms to Live By: The Computer Science of Human Decisions

by Brian Christian

So an Upper Confidence Bound algorithm doesn’t care which arm has performed best so far; instead, it chooses the arm that could reasonably perform best in the future.