They claimed there was only one true Temple, the one in Jerusalem, but rumors abounded, going back to the time when the Roman general Pompey had marched into the Holy of Holies, that the Jews had no image, no statue of their god. Hence the charge of atheism.
