robots.txt Validator

Checks syntax, detects blocked AI bots (GPTBot, ClaudeBot) and validates the file structure.