ai.robots.txt/ai.txt
2024-04-01 09:56:10 -07:00

6 lines
108 B
Text

# Spawning AI
# Prevent datasets from using the following file types
User-Agent: *
Disallow: /
Disallow: *