Opposing positive discrimination based on apprehensions about getting the best person for the job means inadvertently revealing what you think talent looks like, and the kind of person in which you think talent resides. Because, if the current system worked correctly, and if hiring practices were successfully recruiting and promoting the right people for the right jobs in all circumstances, I seriously doubt that so many leadership positions would be occupied by white middle-aged men.
