It is possible that your prefrontal cortex and other social brain areas grow in size as a result of how much they are used, though this probably doesn’t continue much after the mid-twenties. Be that as it may, by the time you reach adulthood it seems that your brain is probably pretty much fixed.
