Gay men are likely to have a smaller third interstitial nucleus in the anterior hypothalamus, a nucleus known to have a role in sex differences. 39 And convicted murderers and other violent, antisocial people are likely to have a smaller and less active prefrontal cortex, the part of the brain that governs decision making and inhibits impulses.