A given ruling class rules over a given society precisely because it is able to control the major social forces that are active within that society. If a social force—religion, let us say—declines in importance, then the section of the ruling class whose position was dependent upon control of religion likewise, over a period, declines.
