ai.robots.txt/code
Dennis Camera 0bd3fa63b8 table-of-bot-metrics.md: Escape robot names for Markdown table
Some characters which could occur in a crawler's name have a special meaning in
Markdown. They are escaped to prevent them from having unintended side effects.

The escaping is only applied to the first (Name) column of the table. The rest
of the columns is expected to already be Markdown encoded in robots.json.
2025-02-18 12:53:27 +01:00
..
test_files .htaccess: Make regex in RewriteCond safe 2025-02-18 12:53:22 +01:00
robots.py table-of-bot-metrics.md: Escape robot names for Markdown table 2025-02-18 12:53:27 +01:00
tests.py Implementing htaccess generation 2025-01-07 11:02:29 +01:00