cdransf/coryd.dev-eleventy
Archived
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

chore: dry up robots.txt templating

Browse source
This commit is contained in:
Cory Dransfeldt 2024-02-01 12:31:43 -08:00
parent 29915a2e2c
commit 3edecfe47c
No known key found for this signature in database
4 changed files with 26 additions and 42 deletions
Download patch file Download diff file Expand all files Collapse all files

17
src/_data/json/robots.js Normal file
View file

@ -0,0 +1,17 @@
export default [
'AdsBot-Google',
'Amazonbot',
'anthropic-ai',
'ArcMobile2',
'Bytespider',
'CCBot',
'ChatGPT-User',
'cohere-ai',
'FacebookBot',
'Google-Extended',
'GPTBot',
'omgili',
'Omgilibot',
'PerplexityBot',
'YouBot',
]