From 15fc333a705f09003e703eb98314d60d9b4ee6b6 Mon Sep 17 00:00:00 2001 From: Erdem Date: Mon, 6 Jan 2025 02:38:12 +0300 Subject: [PATCH] Update robots.txt Added NBot --- robots.txt | 1 + 1 file changed, 1 insertion(+) diff --git a/robots.txt b/robots.txt index 1ae5558..0bbf1e6 100644 --- a/robots.txt +++ b/robots.txt @@ -40,4 +40,5 @@ User-agent: Timpibot User-agent: VelenPublicWebCrawler User-agent: Webzio-Extended User-agent: YouBot +User-agent: NBot Disallow: /