Whether you shift to the pleasant sensation because your breath has gotten too subtle or because you’ve been at access concentration “long enough,” you will need a good bit of concentration to continuously notice a pleasant sensation. A mildly pleasant physical sensation somewhere in your body is not nearly as exciting as the breath coming in and the breath going out. You’re experiencing this mildly pleasant sensation that’s just sitting there; you need to be well concentrated to stay with it.
