From 39363fc813f5017906240de2eb677cbfb48fa327 Mon Sep 17 00:00:00 2001 From: Christopher Kirk-Nielsen Date: Wed, 12 Jun 2024 16:43:12 -0400 Subject: [PATCH] Block Applebot-Extended Per [Apple's docs](https://support.apple.com/en-us/119829#datausage) ([via Matthew Bogart](https://matthewbogart.com/@matt/112605297864483766)) --- robots.txt | 1 + 1 file changed, 1 insertion(+) diff --git a/robots.txt b/robots.txt index fc122f3..610cc1b 100644 --- a/robots.txt +++ b/robots.txt @@ -2,6 +2,7 @@ User-agent: AdsBot-Google User-agent: Amazonbot User-agent: anthropic-ai User-agent: Applebot +User-agent: Applebot-Extended User-agent: AwarioRssBot User-agent: AwarioSmartBot User-agent: Bytespider