These social phrases are known as phatic expressions, and their meaning is more about the context you say them in than the sum of their individual words. “How’s it going?” and “What’s up?” have the same function: they both acknowledge the presence of someone you already know in a way that’s slightly more elaborate than a simple greeting (“Hi!”) but doesn’t go so far as to be an original conversation.