Demonstrations of the abilities of LLMs can seem more impressive than they actually are because they are so good at producing answers that sound correct, at providing the illusion of understanding. High test scores can come from the AI’s ability to solve problems, or it could have been exposed to that data in its initial training, essentially making the test an open book. Some researchers argue that almost all the emergent features of AI are due to these sorts of measurement errors and illusions, while others argue that we are on the edge of building a sentient artificial entity. While these
...more
