I worked with a team that helped students choose university courses who set their outcome as “Increase the number of course reviews on our platform.” When I asked them what the impact of more reviews was, they answered, “More students would see courses with reviews.” That’s not necessarily true. The team could have increased the number of reviews on their platform, but if they all clustered around a small number of courses, or if they were all on courses that students didn’t view, they wouldn’t have an impact. A better outcome is “Increase the number of course views that include reviews.” To
...more
