chore: contribution note

This commit is contained in:
Cory Dransfeldt 2024-08-02 09:31:48 -07:00 committed by GitHub
parent b144225ece
commit 349c35eed6
No known key found for this signature in database
GPG key ID: B5690EEEBB952194

View file

@ -8,6 +8,10 @@ A number of these crawlers have been sourced from [Dark Visitors](https://darkvi
If you'd like to add information about a crawler to the list, please make a pull request with the bot name added to `robots.txt`, `ai.txt`, and any relevant details in `table-of-bot-metrics.md` to help people understand what's crawling.
## Contributing
A note about contributing: updates should be added/made to `robots.json`. A GitHub action, courtesy of [Adam](https://github.com/newbold), will then generate the updated `robots.txt` and `table-of-bot-metrics.md`.
## Subscribe to updates
You can subscribe to list updates via RSS/Atom with the releases feed: