When Newton was three, his mother remarried and moved. Newton didn’t accompany his mother and stepfather. As a result, he had little contact with his parents after that, unless you count the time he threatened to come over and burn their house down with them inside.