# Global rules User-agent: * Allow: / Allow: /venues/ Allow: /schedule/ Disallow: /admin/ Disallow: /api/ # AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.) # are allowed on purpose so The Benderz can be cited as Philly's party/cover band. # Sitemap location Sitemap: https://thebenderz.com/sitemap.xml # Optional: Rate limiting for aggressive bots User-agent: AhrefsBot Crawl-delay: 10 User-agent: SemrushBot Crawl-delay: 10