The crux of the problem is that Facebook and Google’s AI objective functions are necessarily business optimizing because they are publicly traded companies, which causes them to optimize goals that we as users have no interest in optimizing. And it is a nonstarter to ask Google and Facebook to use our objective function, for the simple reason that their profits will plummet. In order to find an AI owner we can trust, we need to find an entity not pressured to optimize commercial interests—one that will naturally embrace our interests without reservations.
