mirror of
https://github.com/ai-robots-txt/ai.robots.txt.git
synced 2025-04-04 19:13:57 +00:00
commit
543dfc8452
2 changed files with 2 additions and 0 deletions
|
@ -1,5 +1,7 @@
|
|||
# AI robots.txt
|
||||
|
||||
<img src="noai-logo.png" width="100" />
|
||||
|
||||
This is an open list of web crawlers associated with AI companies and the training of LLMs to block. We encourage you to contribute to and implement this list on your own site.
|
||||
|
||||
A number of these crawlers have been sourced from [Dark Visitors](https://darkvisitors.com) and we appreciate the ongoing effort they put in to track these crawlers.
|
||||
|
|
BIN
noai-logo.png
Normal file
BIN
noai-logo.png
Normal file
Binary file not shown.
After Width: | Height: | Size: 48 KiB |
Loading…
Reference in a new issue