This slight mismatch between the Julian and tropical years was unnoticeable enough that, by 1500 CE, pretty much all of Europe and parts of Africa were using the Julian calendar. But the Catholic Church was sick of Jesus’s death (celebrated according to the seasons) drifting away from his birth (celebrated on a set date).
