Algorithms to Live By: The Computer Science of Human Decisions

by Brian Christian

Win-Stay, Lose-Shift algorithm: choose an arm at random, and keep pulling it as long as it keeps paying off. If the arm doesn’t pay off after a particular pull, then switch to the other one.