Per-bot AI rules
Correctly-spelled, non-contradictory groups for named AI bots (GPTBot, ClaudeBot, …) in robots.txt. (site-wide file)
Broken variant
A misspelled token (GPT-Bot), a group that both Allows and Disallows /, an empty group, and a duplicated group.
Defect metrics
perBotRuleMisspelledToken |
perBotRuleContradictoryAllowDisallow |
perBotRuleEmptyGroup |
perBotRuleDuplicateGroup |