cdransf/coryd.dev-eleventy
Archived
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

chore: update robots.txt

Browse source
This commit is contained in:
Cory Dransfeldt 2023-10-01 17:56:29 -07:00
parent 361096e5ff
commit eeb2156d40
3 changed files with 14 additions and 5 deletions
Download patch file Download diff file Expand all files Collapse all files

14
src/meta/robots.liquid
View file

@ -8,8 +8,20 @@ Sitemap: https://coryd.dev/sitemap.xml
User-agent: *
Disallow:
User-agent: GPTBot
User-agent: CCBot
Disallow: /
User-agent: ChatGPT-User
Disallow: /
User-agent: GPTBot
Disallow: /
User-agent: Google-Extended
Disallow: /
User-agent: Omgilibot
Disallow: /
User-agent: FacebookBot
Disallow: /