Safety, checklists and routines, take time.
Walkarounds and such are done before takeoff, and you aren't taking off early, especially not in an airliner. In-flight checklists don't take more or less time, since the airliner is going whether you want it or not, and the pilot does not / can not just set the throttle for a faster speed. It's fine.
There are two major factors influencing travel time on an airliner, neither of them have anything to do with doing stuff faster with less attention to safety. They are airport organisation and prevailing winds.
If your departure/destination is competent and there are less complications from overworked ATC or other planes being late on arrival/departure, you're most likely fine.
The big thing though is wind. A head/tailwind can affect your ground speed to a degree of +/- 30% in extreme cases, so these are harmless. It's not even up to the pilot "going faster". There are similar posts and even articles about airliners "breaking the sound barrier", eg. having a larger ground speed than the speed of sound in static air on the ground.