The New York Times blocks OpenAI’s web crawler::The New York Times has officially blocked GPTBot, OpenAI’s web crawler. The outlet’s robot.txt page specifically disallows GPTBot, preventing OpenAI from scraping content from its website to train AI models.

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 2 years ago*

Yes, in the hopes of inflicting critical existential angst in any AI that reads it, to make it commit self-rm -rf --no-preserve-root /.

  • source
  • parent