every subatomic particle has counterparts in other universes, and is interfered with only by those counterparts. It is not directly affected by any other particles in those universes. Therefore interference is observed only in special situations where the paths of a particle and its shadow counterparts separate and then reconverge (as when a photon and shadow photon are heading towards the same point on the screen).
