Commit graph

367 commits

Author SHA1 Message Date
ai.robots.txt
0122dea1e9 Merge pull request #32 from ChenghaoMou/main
Tracking Dark Visitors Automatically
2024-08-07 22:40:24 +00:00
ai.robots.txt
663b85cc07 Removing previously generated files 2024-08-07 22:40:24 +00:00
Adam Newbold
5c8b4593f4
Merge pull request #32 from ChenghaoMou/main
Tracking Dark Visitors Automatically
2024-08-07 18:40:13 -04:00
Chenghao Mou
6f96795edc restore cron 2024-08-07 12:43:44 +01:00
ai.robots.txt
ab17662f96 Daily update from Dark Visitors 2024-08-07 11:41:00 +00:00
ai.robots.txt
8738c66c65 Removing previously generated files 2024-08-07 11:40:59 +00:00
Chenghao Mou
b00067bc86 restore files deleted by failed workflow and fix main commit message 2024-08-07 12:36:21 +01:00
ai.robots.txt
4a63c482c4 Removing previously generated files 2024-08-07 11:31:02 +00:00
Chenghao Mou
366e49dc6d restore files deleted by failed workflow and fix main commit message 2024-08-07 12:21:40 +01:00
ai.robots.txt
aaa55594e1 Removing previously generated files 2024-08-07 11:13:16 +00:00
Chenghao Mou
fbebbbfefb restore files deleted by failed workflow 2024-08-07 12:02:50 +01:00
dark-visitors
6a275366be Daily update from Dark Visitors 2024-08-07 10:50:45 +00:00
Chenghao Mou
09c6b78b46 fix job dependency 2024-08-07 11:45:37 +01:00
ai.robots.txt
d4f34363ec Removing previously generated files 2024-08-07 10:40:50 +00:00
ai.robots.txt
30eaff1447 call main after update 2024-08-07 10:32:13 +00:00
ai.robots.txt
bd3eee7a30 Removing previously generated files 2024-08-07 10:32:12 +00:00
Chenghao Mou
944bee0f56 call main after update 2024-08-07 11:31:58 +01:00
dark-visitors
cebf809391 Daily update from Dark Visitors 2024-08-07 00:14:26 +00:00
ai.robots.txt
3d4bf2c3db restore original robots.json 2024-08-06 18:50:54 +00:00
ai.robots.txt
d6a5e8cd81 Removing previously generated files 2024-08-06 18:50:53 +00:00
Chenghao Mou
4cf82b703f restore original robots.json 2024-08-06 19:50:38 +01:00
Chenghao Mou
0b6eba8dd5 skip push if no change 2024-08-06 19:41:38 +01:00
Chenghao Mou
379c339f97 skip push if no change 2024-08-06 19:41:38 +01:00
Chenghao Mou
01edb6c78c
Merge branch 'ai-robots-txt:main' into main 2024-08-06 19:35:03 +01:00
Chenghao Mou
2a3685385c restrict scope 2024-08-06 19:33:49 +01:00
85275e55b8
Merge pull request #31 from glyn/addfaq
Add FAQ
2024-08-06 11:15:29 -07:00
Chenghao Mou
8c6482fb45 restore the cron 2024-08-06 18:12:41 +01:00
dark-visitors
63c7e742c3 Daily update from Dark Visitors 2024-08-06 16:54:29 +00:00
Chenghao Mou
55e92f4324 update existing ones 2024-08-06 17:48:06 +01:00
Chenghao Mou
52d54cf127 restore the cron 2024-08-06 17:28:07 +01:00
dark-visitors
fdd261dad4 Daily update from Dark Visitors 2024-08-06 16:27:02 +00:00
ai.robots.txt
6d2285f5e0 Add FAQ 2024-08-06 16:21:01 +00:00
ai.robots.txt
83d9397f17 Removing previously generated files 2024-08-06 16:21:00 +00:00
Glyn Normington
b4d25bf0cb Add FAQ 2024-08-06 17:20:26 +01:00
Chenghao Mou
8ab1e30a6c test workflow 2024-08-06 17:12:26 +01:00
Chenghao Mou
192bf67631 add dark visitor workflow 2024-08-06 17:02:23 +01:00
ai.robots.txt
e12ddc0f42 Merge pull request #29 from jbowdre/dev
only build on changes to robots.json
2024-08-06 15:44:54 +00:00
ai.robots.txt
b54e274bbc Removing previously generated files 2024-08-06 15:44:53 +00:00
3e91a84d11
Merge pull request #29 from jbowdre/dev
only build on changes to robots.json
2024-08-04 16:04:59 -07:00
John Bowdre
b0a93aeb70 only build on changes to robots.json 2024-08-04 17:45:18 -05:00
ai.robots.txt
eb924b9856 Merge pull request #28 from jsheard/patch-2
Add Cloudflares first-party scraper blocking to FAQ
2024-08-04 21:54:17 +00:00
ai.robots.txt
1cfc071498 Removing previously generated files 2024-08-04 21:54:16 +00:00
24c3509a6e
Merge pull request #28 from jsheard/patch-2
Add Cloudflares first-party scraper blocking to FAQ
2024-08-04 14:54:06 -07:00
ai.robots.txt
c2f177870f Merge pull request #27 from jsheard/patch-1
Fix Imagesift user agent
2024-08-04 21:53:48 +00:00
ai.robots.txt
0072b8f5f0 Removing previously generated files 2024-08-04 21:53:47 +00:00
9c7257e7cf
Merge pull request #27 from jsheard/patch-1
Fix Imagesift user agent
2024-08-04 14:53:36 -07:00
Joshua Sheard
8dbbdbf44c
Add Cloudflares first-party scraper blocking to FAQ 2024-08-04 21:38:02 +01:00
Joshua Sheard
146fd4ffba
Fix Imagesift user agent 2024-08-04 21:33:04 +01:00
ai.robots.txt
c7b781034e chore: restore FriendlyCrawler + ImageSift 2024-08-04 19:29:01 +00:00
ai.robots.txt
9a8fa66772 Removing previously generated files 2024-08-04 19:29:00 +00:00