Santosh Shetty

42%
Flag icon
“It’s a classic intelligence test [that] AI’s failed on,” Jones says. “We couldn’t get common sense into a neural network.” But when they fed those same sentences into the transformer, the researchers could see something unusual happening to its “attention head.” The attention head was like a mini-detector in their model that focused on different parts of data it was being fed. It was the part that would harness the power of current chips and what allowed the transformer to pay attention to all the different words of a sentence at the same time, instead of one by one in sequence. When the ...more
Supremacy: AI, ChatGPT, and the Race that Will Change the World
Rate this book
Clear rating
Open Preview