But a more careful look at the data revealed something both more impressive and somewhat worrying. Though the consultants were expected to use AI to help them with their tasks, the AI seemed to be doing much of the work. Most experiment participants were simply pasting in the questions they were asked, and getting very good answers. The same thing happened in the writing experiment done by economists Shakked Noy and Whitney Zhang from MIT, which we discussed in chapter 5—most participants didn’t even bother editing the AI’s output once it was created for them. It is a problem I see repeatedly
...more
