Under the hood, a new type of machine learning model known as a “transformer”—easily the biggest evolutionary leap in the neural network’s design since AlexNet in 2012—makes LLMs possible by embodying all of the necessary qualities: mammoth scale, the ability to accelerate training time by processing the data in large, parallel swaths, and an attention mechanism of incredible sophistication.
