If an AI developer produces a large language model that is able to create recipes for bioweapons, “it’s because they trained it on a dataset that included information on bioweapons,” says Sarah Myers West, the co–executive director of AI Now Institute and former senior adviser on AI to the FTC. As always, the neural network is surfacing patterns within its training data. Opening up that data would be the first step to establishing scientific clarity on what kinds of inputs could lead to dangerous outputs.
