Yes, the spatial issues present a problem based on our rudimentary understanding of such matters...The Tollans, who think quantum physics is beginers thought and wrong, and the Ancients, might figure it out (Stargate references. Oh, on your recommendation I did binge and enjoy Farscape. Lots of philosophy/spirituality to think about there, particularly the final season, if I'm recalling the progression correctly).
I have my own theory of time, alternate realities, and or time travel if you will, and it is based on reincarnation and the fact that this is my soul's 17,043rd human incarnation (no, I don't have memories of any previous lives), which I realized before others pointed it out to me doesn't fit with our understanding of when our species evolved. Thus I had this epiphany: Specifically as to time, I believe that souls are time travelers in that we can choose to improv-script our masterclasses at any point in time. I do not believe an already-lived life has to have taken place in the past nor that a yet-to-be-lived life has to take place in the future. I do not believe that the paradoxes of timeline crossing as discussed in science fiction present an issue. Each chosen setting is an alternate reality.
I know this is not what you mean by time travel. I don't feel bound by the specific scope of an article when I leave a comment :-)