How time passes. This was not the case when down-votes were there. It used to be easy to identify when videos were full of shit, even with lots of views.

This might help others. It's crowd-sourced and uses averages, but for what it "feels" like, it seems pretty accurate:

https://addons.mozilla.org/en-US/firefox/addon/return-youtube-dislikes/