I mean if you have a super nice working environment (team etc.), I don't see an issue with staying at the company.

But yeah as you say, if the new company is better in every single way, of course you should move.