The recommendations given by Upper Confidence Bound algorithms will be similar to those provided by the Gittins index, but they are significantly easier to compute, and they don’t require the assumption of geometric discounting. Upper Confidence Bound algorithms implement a principle that has been dubbed “optimism in the face of uncertainty.”
