I have witnessed many cases in which pastors grieve over people who have left, whether from the staff or the congregation. In most instances those people were upset because truth was preached, and it confronted their lifestyles. They would then become critical of every aspect of the church and leave.
