cdransf/ai.robots.txt
1
1
Fork 0
mirror of https://github.com/ai-robots-txt/ai.robots.txt.git synced 2025-04-05 03:17:46 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 1

chore: add img2dataset to table-of-bot-metrics.md

Browse source
This commit is contained in:
Cory Dransfeldt 2024-04-22 09:30:00 -07:00 committed by GitHub
parent 5025939e5d
commit 29e0799332
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
table-of-bot-metrics.md
View file

@ -17,6 +17,7 @@
|Google-Extended| | | | | | |Google-Extended| | | | | |
|GoogleOther | | | | | | |GoogleOther | | | | | |
|GPTBot | [OpenAI](https://openai.com) | Yes | Scrapes data to train OpenAI's products. | No information provided. | Data is used to train current and future models, removed paywalled data, PII and data that violates the company's policies. | |GPTBot | [OpenAI](https://openai.com) | Yes | Scrapes data to train OpenAI's products. | No information provided. | Data is used to train current and future models, removed paywalled data, PII and data that violates the company's policies. |
| img2dataset | | | | | |
|ImagesiftBot | | | | | | |ImagesiftBot | | | | | |
|magpie-crawler | | | | | | |magpie-crawler | | | | | |
|Meltwater | | | | | | |Meltwater | | | | | |