Riemann made it perfectly acceptable to go off to infinity; since infinity is just a point on the sphere like any other point, it was no longer something to be feared. In fact, mathematicians started analyzing and classifying the points where a function blows up: singularities.
