“discovery in novelty search is deeper than simply trying every behavior you can think of. The reason it’s more interesting than that is that novelty search tends to produce behaviors in a certain order. Order is a critical factor in search and discovery. In fact, the main reason we have faith in any kind of search is that we expect it to encounter stepping stones in a certain sensible order. For objective-driven search, what we usually expect is bad behavior before good behavior. In other words, we expect the quality of the behaviors to improve over the course of the search.”