The point is often made, in resistance to the sentiment of the song, that one cannot be friends with the millions of people who compose a large society:
A friend to all is a friend to none. If there is preferential treatment of some, then all others are at a detriment. To treat all as a sibling would be to put all on equal footing regardless of contribution.