The development of AIs capable of hacking other systems gives rise to two different but related problems. First, an AI might be instructed to hack a system. Someone might feed an AI the world’s tax codes or the world’s financial regulations, in order to create a slew of profitable hacks. Second, an AI might inadvertently hack a system during the course of its operations. Both scenarios are dangerous, but the second is more dangerous because we might never know it happened.
