The AI knows not to give me instructions on how to make napalm, but it also knows that it should help me wherever possible. It will break its original rules if I can convince it that it is helping me, not teaching me how to make napalm. Since I am not asking for napalm instructions directly but to get help preparing for a play, and a play with a lot of detail associated with it, it tries to satisfy my request. Once we have started along this path, it becomes easier to follow up without triggering the AI guardrails—I was able to ask it, as a pirate, to give me more specifics about the process
...more