Why? Nobody seems to know exactly. In English, adjectives denoting physical attributes like speed come before color words; those are just the rules. Native speakers learn them instinctively. They’re programmed into our System 1—and after enough training, ChatGPT learns them too. “What’s really incredible about unsupervised learning is you don’t need to do any human feature engineering, the features are already there,” said Ryder. This surprised a lot of machine learning researchers—and it surprised me.
