“When one is deprived of ones liberty, one is right in blaming not so much the man who puts the shackles on as the one who had the power to prevent him, but did not use it.”