The crazy thing is that no one is entirely sure why a token prediction system resulted in an AI with such seemingly extraordinary abilities. It may suggest that language and the patterns of thinking13 behind it are simpler and more “law-like” than we thought and that LLMs have discovered some deep and hidden truths about them, but the answers are still unclear. And we may never know exactly how they are thinking, as Professor Sam Bowman of New York University wrote of the neural networks underlying LLMs: “There are hundreds of billions of connections between these artificial neurons, some of
...more
