You would know that, even though the universe seemed to have a certain layout and obey certain laws, there must be a wider universe outside it, obeying different laws of physics. And you could even guess some of the ways in which these wider laws would have to differ from the chessboard laws.
