AI & I: An Intellectual History of Artificial Intelligence

by Eugene Charniak

When you use a language model to generate text, you first compute the probability of all possible next word pieces.