There needn't actually be a universe at all. For the longest time there wasn't. There were no atoms and no universe for them to float about in. There was nothing—nothing at all anywhere.
"For the longest time there wasn't." It's not actually clear that there was time before the universe began.