Here's a good article about the way novel lengths have been influenced by technology and marketing, with an except I found particularly enlightening:
Welcome back. Just a moment while we sign you in to your Goodreads account.