In our culture, many people think that mathematical ability is particularly indicative of intelligence, and that it is based on inherent talent rather than hard work. This view is questionable but very pervasive. As a result, those who have always been good at mathematics tend to be thought somewhat special, and this gets built into their sense of why they are worthwhile human beings. So, if they no longer stand out, it can shake their sense of their place in the world.