Mindfulness is the most important aspect of meditation. It is the primary thing that you are trying to cultivate. So there is really no need at all to struggle against distractions. The crucial thing is to be mindful of what is occurring, not to control what is occurring.