It depends on the type of time travel rules. One theory suggest going back in time creates a branch in the time-space continuum, one where the time travel happened, one where it did not.

With this branching time-space rule, there's one timeline, where no time travellers appeared, and one where they did.