cdransf/coryd.dev-eleventy
Archived
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

chore: block more ai bots

Browse source
This commit is contained in:
Cory Dransfeldt 2024-01-29 10:32:54 -08:00
parent b455172fc2
commit 9d85f1b834
No known key found for this signature in database
1 changed files with 16 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

17
src/meta/robots.liquid
View file

@ -11,6 +11,12 @@ Disallow:
User-agent: AdsBot-Google User-agent: AdsBot-Google
Disallow: / Disallow: /
User-agent: Amazonbot
Disallow: /
User-agent: anthropic-ai
Disallow: /
User-agent: Bytespider User-agent: Bytespider
Disallow: / Disallow: /
@ -20,6 +26,9 @@ Disallow: /
User-agent: ChatGPT-User User-agent: ChatGPT-User
Disallow: / Disallow: /
User-agent: cohere-ai
Disallow: /
User-agent: FacebookBot User-agent: FacebookBot
Disallow: / Disallow: /
@ -29,8 +38,14 @@ Disallow: /
User-agent: GPTBot User-agent: GPTBot
Disallow: / Disallow: /
User-agent: Omgili User-agent: omgili
Disallow: / Disallow: /
User-agent: Omgilibot User-agent: Omgilibot
Disallow: /
User-agent: PerplexityBot
Disallow: /
User-agent: YouBot
Disallow: / Disallow: /