The optimates hated and feared his relentless desire for change and glory, and were terrified of his disregard for things like convention, propriety and the law. Because Caesar was astoundingly corrupt. He bribed his way into his first official job and didn’t stop from that point on.
