Frictional forces are not fundamental. They are a consequence of a body interacting with a huge number of other tiny bodies—atoms and molecules—that are too small and too numerous to keep track of. So we average over all the hidden degrees of freedom.
