They may not understand everything the leader does with his time, but they will be able to tell if the leader stewards it well. The proof is in the quality of leadership, and the quality of leadership will determine the effectiveness of the entire organization.
