More than 1h drive and I should spend half a day there.
More than 2h, I should plan the whole day (leaving in the morning and coming back end of the day)
More than 4 hours and I need to spend at least a night there before coming back.
I don't like to drive long distance at all. Obviously, all of that depend what I'm doing there.