cdransf/ai.robots.txt
1
1
Fork 0
mirror of https://github.com/ai-robots-txt/ai.robots.txt.git synced 2025-04-19 08:26:02 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 2

Update from Dark Visitors
Some checks failed
/ run-tests (push) Has been cancelled
Details

Browse source
This commit is contained in:
ai.robots.txt 2025-03-29 00:54:10 +00:00
parent c249de99a3
commit 5b8650b99b
3 changed files with 4 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

1
robots.txt
View file

@ -35,6 +35,7 @@ User-agent: omgili
User-agent: omgilibot
User-agent: PanguBot
User-agent: PerplexityBot
User-agent: Perplexity‑User
User-agent: PetalBot
User-agent: Scrapy
User-agent: SemrushBot-OCOB