Pedestrians Have the Right of Way

So, from what I understand, pedestrians have the right of way.  OK, I get this.  Everybody in the free fucking world KNOWS that you're supposed to stop and let pedestrians pass in front of you in parking lots and cross walks etc.  

But here's the thing.  I am in a 4000 pound hunk of steel, while you weigh like, 300 pounds at most.  I mean, yes, you are a fucking whale, but lets be real here, I don't HAVE to stop for you, I don't HAVE to do shit when I outweigh you...