On the other hand, there are lots of bots scraping Wikipedia even though it's easy to download the entire website as a single archive.

So they're not really that smart....