That is why the specialness of self is such a strong intuition. For our ancestors, it was often either them or the other guy, and genes that encouraged them to think the other guy was as important as they were wouldn’t have gone anywhere. So the sense of specialness and the attendant baggage of “self,” whatever you think of them, were unavoidable features of sentient life so long as life was created by natural selection.