They had always feared their neighbors, perceiving them as giants. But in truth their neighbors feared the Israelites because of their God.
But how can you know this from the start? Or do you have to rely on a faith so strong that you power through anyway? Could their have been some middle ground between invade and don't invade?