It’s not impossible to set up a finite version of arithmetic with a very big largest number, but it’s inelegant and difficult to work with. Mathematicians prefer their patterns to be universal in scope, so they embrace the infinitude of the whole numbers. Infinity is simpler than some specific but inexplicit very large number.