166
The New York Times blocks OpenAI’s web crawler (www.theverge.com)
submitted 2 years ago by [M, B] to c/technology@lemmy.world
16 comments fedilink hide all child comments
 

The New York Times blocks OpenAI’s web crawler::The New York Times has officially blocked GPTBot, OpenAI’s web crawler. The outlet’s robot.txt page specifically disallows GPTBot, preventing OpenAI from scraping content from its website to train AI models.

you are viewing a single comment's thread
view the rest of the comments
[–] -2 points 2 years ago

Maybe you are not thinking about the capabilities of AI fully there are ones that are enriched with recent data, so your can ask it about recent events. Also, I do ask it about historical information, so it is nice to have that available.

  • permalink
  • fedilink
  • source
  • parent