From 3e57b5ab5d7486808b08ceb985d229f06c6ae5c4 Mon Sep 17 00:00:00 2001
From: --Explosion-- <explosion.scratch@gmail.com>
Date: Thu, 28 Mar 2024 10:00:58 -0500
Subject: [PATCH] Add GoogleOther
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit

Used by Google to crawl for internal research and development. It’s unknown what exactly this entails, but is a generic user agent that is used when no other appropriate user agent is available. Documentation available from Google: https://developers.google.com/search/docs/crawling-indexing/overview-google-crawlers
---
 robots.txt | 1 +
 1 file changed, 1 insertion(+)

diff --git a/robots.txt b/robots.txt
index 9dd8fef..0f24897 100644
--- a/robots.txt
+++ b/robots.txt
@@ -13,6 +13,7 @@ User-agent: cohere-ai
 User-agent: DataForSeoBot
 User-agent: FacebookBot
 User-agent: Google-Extended
+User-agent: GoogleOther
 User-agent: GPTBot
 User-agent: ImagesiftBot
 User-agent: magpie-crawler