Quality is subjective, of course, but the host’s sentiment speaks to how users can feel misunderstood and misjudged by algorithmic evaluations. “It’s like an exam, but you don’t know what’s going to be on this exam, or how to score well on this exam,” Jhaver explained. And it’s not just the users who don’t know what’s going on. Jhaver continued: “At the end of the day, even the people who create the algorithms cannot tell you which factor was responsible for which decision; the complexity of the algorithm is so high that disentangling different factors is just not possible.”
