This is why I think time travel will require both an entry and an exit portal, though it’d be through the same device. You’d walk in the portal at one point in time and space, then walk out of the exact same portal at another point in time and space. You’d only be able to travel between points where that time device exists in time and space, you’re using the same portal to travel to a different time in its existence. So no traveling back to the time of dinosaurs or the beginning of time or going to any point past when the portal no longer exists anymore. It’d solve the problem of having to deal with galaxies/stars/planets moving through space and would help mitigate some paradoxes, though not all and maybe even create others.