ai.robots.txt
|
1c470babbe
|
Merge pull request #123 from joehoyle/patch-1
Fix JSON syntax error
|
2025-05-15 16:12:30 +00:00 |
|
ai.robots.txt
|
c6c7f1748f
|
Update from Dark Visitors
/ run-tests (push) Has been cancelled
|
2025-04-26 00:55:12 +00:00 |
|
ai.robots.txt
|
4654e14e9c
|
Merge pull request #112 from maiavixen/main
/ ai-robots-txt (push) Waiting to run
/ run-tests (push) Waiting to run
Fixed meta-external* being titlecase, and removed period for consistency
|
2025-04-24 07:00:34 +00:00 |
|
ai.robots.txt
|
bbec639c14
|
Merge pull request #109 from dennislee1/patch-1
/ ai-robots-txt (push) Waiting to run
/ run-tests (push) Waiting to run
AI bots to consider adding
|
2025-04-22 14:50:26 +00:00 |
|
ai.robots.txt
|
e0cdb278fb
|
Update from Dark Visitors
/ run-tests (push) Has been cancelled
|
2025-04-16 00:57:11 +00:00 |
|
ai.robots.txt
|
4a764bba18
|
Merge pull request #102 from ai-robots-txt/imgproxy-bot
/ run-tests (push) Waiting to run
chore(robots.json): adds imgproxy crawler
|
2025-04-10 19:22:34 +00:00 |
|
Frederic Barthelemy
|
5f5a89c38c
|
Fix html-mangled hyphen in Perplexity-Users
Fixes: #99
|
2025-04-04 17:34:14 -07:00 |
|
ai.robots.txt
|
6851413c52
|
Merge pull request #94 from ThomasLeister/feature/implement-nginx-configuration-snippet-export
Implement Nginx configuration snippet export
|
2025-03-27 19:49:15 +00:00 |
|
Thomas Leister
|
4f3f4cd0dd
|
Add assembled version of nginx-block-ai-bots.conf file
|
2025-03-27 12:43:36 +01:00 |
|