Anything that puts a stress on your mind or body can interfere with the physiology of self-control, and by extension, sabotage your willpower. Anxiety, anger, depression, and loneliness are all associated with lower heart rate variability and less self-control.