mirror of
https://github.com/ai-robots-txt/ai.robots.txt.git
synced 2025-05-17 16:03:10 +00:00
This commit is contained in:
parent
934ac7b318
commit
c6c7f1748f
4 changed files with 6 additions and 2 deletions
|
@ -34,7 +34,9 @@ User-agent: imgproxy
|
|||
User-agent: ISSCyberRiskCrawler
|
||||
User-agent: Kangaroo Bot
|
||||
User-agent: meta-externalagent
|
||||
User-agent: Meta-ExternalAgent
|
||||
User-agent: meta-externalfetcher
|
||||
User-agent: Meta-ExternalFetcher
|
||||
User-agent: NovaAct
|
||||
User-agent: OAI-SearchBot
|
||||
User-agent: omgili
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue