Sure but we're in the comments section of an article about wikipedia being crawled, which is silly because they could just download a snapshot of wikipedia
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
replies: