robots.txt Generator

GPTBot (OpenAI) ClaudeBot (Anthropic) anthropic-ai (Anthropic) CCBot (Common Crawl) PerplexityBot (Perplexity AI) Google-Extended (Google) Bytespider (ByteDance) Amazonbot (Amazon) FacebookBot (Meta) Applebot-Extended (Apple) Diffbot (Diffbot) cohere-ai (Cohere) ImagesiftBot (Imagesift) omgili (Webz.io) Timpibot (Timpi) YouBot (You.com) PetalBot (Huawei) Webzio-Extended (Webz.io) DataForSeoBot (DataForSEO) TurnitinBot (Turnitin) AI2Bot (Allen AI) Scrapy (Scrapy)