When do you stop world-building?

Have you noticed how often fantasy and science fiction - speculative fiction - comes in fat trilogies? And how historical fiction is a bit that way inclined as well? That's partly because of the need for what spec fickers (rightly) call "world-building" and hist fickers (less wisely) call "the researched...