531
Google is no longer asking — feed the AI or you’re not in search results (pivot-to-ai.com)
submitted 2 years ago by to c/technology@lemmy.world
97 comments fedilink hide all child comments
 

cross-posted from: https://awful.systems/post/2178630

you are viewing a single comment's thread
view the rest of the comments
[–] 30 points 2 years ago* (last edited 2 years ago) (2 children)

You should put these entries into your robots.txt file.

To block the Google search crawler use for all of your site:

User-agent: Googlebot

Disallow: /

To block the Google AI crawler use:

User-agent: Google-Advanced

Disallow: /

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •