Changelog: Blocking GoogleBot and ChatGPT bot

  • Update 29-09-23: Added a few more bots to block and another source
  • Update: Added more bots, my robots.txt file content and another source post

With the rise of AI and companies profiting from free content online, I, like many others, have decided to just block access to those bots. I will add to my robots.txt file as I find more bots to block.

I don't care about being 'found' on search engines these days, as I don't need it to get freelance work because I rarely do freelance work these days anyway.

Here's my robots.txt file:

# www.robotstxt.org

User-agent: GPTBot
Disallow: /

User-agent: ChatGPT-User
Disallow: /

User-agent: googlebot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: yandex
Disallow: /

User-agent: redditbot
Disallow: /

User-agent: bingbot
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: Omgilibot
Disallow: /

Sources

Edited on
Posted on , by