The view from nowhere can—and, I’d argue, should—involve concern for the well-being of all people (and, if we’re going to be true to Buddhist teaching, and to fairly straightforward moral logic, concern for the well-being of all sentient beings†). The point is just that the concern would be evenly distributed; no one’s welfare is more important than anyone else’s.