Simply stated, no amount of reliability in the assessments of a single rater (nor even agreement between different raters) proves that the consistency lies in the behavior of the person being rated. A rater can persist in beliefs or stereotypes that are unsubstantiated by objective response data or that are substantiated only by interpreting such data in the light of one’s presuppositions.
