The thing about annoyance is that once there’s a spark, you can find more things to stoke it. It grew and amplified between me and them. And eventually the abyss stared back.
I've definitely had jobs where minorly annoying actions of a coworker built up resentment over time!