They are trained by generating relationships between tokens that may seem unrelated to humans but represent some deeper meaning. Add in the randomness that comes with AI output, and you have a powerful tool for innovation. The AI seeks to generate the next word in a sequence by finding the next likely token, no matter how weird the previous words were. So it should be no surprise that the AI can come up with novel concepts with ease.
