After some time it "learns" you don't want it.
But what grinds my gears instead are auto-translated video titles.
Because I am watching maybe 70-80% english content I decided the lesser evil is to just set the language to english instead.
Annoying as fuck but managable.