By any measure, the impact of consumptive outdoor sports on nature pales in comparison to the destruction of habitat by urban sprawl and pollution. Remove hunting and fishing from human activity, and we lose many of the voters and organizations that now work against the destruction of woods, fields, and watersheds.
Sure, brah. It's okay if we hurt nature just a little! We're allowed! We know exactly what we're doing, and there definitely couldn't be any unintended consequences!