cdransf/ai.robots.txt
1
1
Fork 0
mirror of https://github.com/ai-robots-txt/ai.robots.txt.git synced 2025-04-12 05:57:45 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 1

Update robots.txt

Browse source 
Added NBot
This commit is contained in:
Erdem 2025-01-06 02:38:12 +03:00 committed by GitHub
parent ca8620e28b
commit 15fc333a70
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
robots.txt
View file

@ -40,4 +40,5 @@ User-agent: Timpibot
User-agent: VelenPublicWebCrawler User-agent: VelenPublicWebCrawler
User-agent: Webzio-Extended User-agent: Webzio-Extended
User-agent: YouBot User-agent: YouBot
User-agent: NBot
Disallow: / Disallow: /