Getting rid of the pushes and email alerts might stop the notifications, but the behaviors themselves have already been internalized. You can delete an app, like I deleted Twitter, and still figure out other ways to access it. You can put your phone on airplane mode after eight p.m., which I do, and still find your tendencies unchecked at eight a.m.
