Time has no meaning without relationship to another point. It is a relational concept, one event relative to another. Thus, to have an arrow or directionality of time, there must be an observer with memory. We’re back to the inescapability of the conscious observer.