This means that you and another interviewer, after seeing the same two candidates in the same panel interview, will still disagree about which of two candidates is better about one-quarter of the time.
A difference makes a difference when it makes a difference. Disagreement between two good ones, or a good and an unqualified ?