cdransf/ai.robots.txt
1
1
Fork 0
mirror of https://github.com/ai-robots-txt/ai.robots.txt.git synced 2025-05-18 00:03:12 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 3

Merge branch 'main' into add-traefik-plugin

Browse source
This commit is contained in:
Florent Poinsaut 2025-05-14 22:06:56 +02:00 • committed by GitHub
commit c66d180295
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 39 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

3
README.md
View file

@ -35,6 +35,9 @@ Note that, as stated in the [httpd documentation](https://httpd.apache.org/docs/
```
(Note that the path of the `haproxy-block-ai-bots.txt` may be different in your environment.)
[Bing uses the data it crawls for AI and training, you may opt out by adding a `meta` tag to the `head` of your site.](./docs/additional-steps/bing.md)
### Related
- [Robots.txt Traefik plugin](https://plugins.traefik.io/plugins/681b2f3fba3486128fc34fae/robots-txt-plugin):