|Name |Operator |Respects `robots.txt` |Data use |Visit regularity |Description | |----------------|---------|-----------------------|----------|------------------|-------------| |AdsBot-Google | | | | | | |Amazonbot | | | | | | |anthropic-ai | | | | | | |Applebot | | | | | | |AwarioRssBot | | | | | | |AwarioSmartBot | | | | | | |Bytespider | | | | | | |CCBot | | | | | | |ChatGPT-User | | | | | | |ClaudeBot | | | | | | |Claude-Web | | | | | | |coher-ai | | | | | | |DataForSeoBot | | | | | | |FacebookBot | | | | | | |Google-Extended| | | | | | |GoogleOther | | | | | | |GPTBot | | | | | | |ImagesiftBot | | | | | | |magpie-crawler | | | | | | |Meltwater | | | | | | |omgili | | | | | | |omgilibot | | | | | | |peer39_crawler| | | | | | |peer39_crawler/1.0| | | | | | |PerplexityBot | | | | | | |PiplBot | | | | | | |Seekr | | | | | | |YouBot | | | | | |