Exploration in itself has value, since trying new things increases our chances of finding the best. So taking the future into account, rather than focusing just on the present, drives us toward novelty.
How much do we discount the future's success compared to a success right now? The more we discount it, the less exploration makes sense.
