“Religion, social status, and property are all sources of power and authority which one man has, to control the liberty of another”