This is my sailing experience every time I play Valheim. I'm starting to believe the devs put in an RNG variable that makes the wind constantly fight you for certain steam IDs or something.
All I'm going to say is that the wind can blow me (although most of the time it blows against me, so...)