cdransf/ai.robots.txt
1
1
Fork 0
mirror of https://github.com/ai-robots-txt/ai.robots.txt.git synced 2025-04-19 16:35:03 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 2

Merge pull request #91 from deyigifts/perplexity-user

Browse source 
Update perplexity bots
This commit is contained in:
ai.robots.txt 2025-03-27 19:29:30 +00:00
parent 1183187be9
commit 68d1d93714
3 changed files with 4 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

1
robots.txt
View file

@ -35,6 +35,7 @@ User-agent: omgili
User-agent: omgilibot
User-agent: PanguBot
User-agent: PerplexityBot
User-agent: Perplexity‑User
User-agent: PetalBot
User-agent: Scrapy
User-agent: SemrushBot-OCOB