The only polite thing to do is to ask them to state your position for you, the position they claim to be challenging. If they cannot do it satisfactorily, if they cannot repeat what you have said in their own words, you know that they do not understand, and you are entirely justified in ignoring their criticisms. They are irrelevant, as all criticism must be that is not based on understanding.