diff --git a/README.md b/README.md index 232b3ed..6183857 100644 --- a/README.md +++ b/README.md @@ -44,6 +44,7 @@ Note that, as stated in the [httpd documentation](https://httpd.apache.org/docs/ middleware plugin for [Traefik](https://traefik.io/traefik/) to automatically add rules of [robots.txt](./robots.txt) file on-the-fly. +- alternatively you can [manually configure Traefik](./docs/traefik-manual-setup.md) to centrally serve a static `robots.txt` ## Contributing A note about contributing: updates should be added/made to `robots.json`. A GitHub action will then generate the updated `robots.txt`, `table-of-bot-metrics.md`, `.htaccess` and `nginx-block-ai-bots.conf`. diff --git a/traefik-manual-setup.md b/docs/traefik-manual-setup.md similarity index 100% rename from traefik-manual-setup.md rename to docs/traefik-manual-setup.md