# Written for production (georgecriminallawyers.com.au). Staging stays
# unindexed via the X-Robots-Tag noindex header in _headers, so shipping
# this file early is safe.
User-agent: *
Allow: /
Disallow: /styleguide/
Disallow: /admin/
Disallow: /dashboard/
Disallow: /sign/

# AI search & assistant crawlers — explicitly allowed (marketing-plan §8:
# citations in AI Overviews/ChatGPT/Perplexity/Claude/Copilot are a client
# acquisition channel for this practice). The wildcard above already
# permits them; these stanzas record intent so a future tightening of the
# wildcard can't silently cut the firm out of AI answers. Each group
# repeats the two Disallows because a named group REPLACES the * group
# for that bot. Never add nosnippet/max-snippet or block Google-Extended.
# Search/citation indexes + user-triggered fetchers + Gemini grounding +
# training corpora (deliberate: models that know the firm can recommend it).
User-agent: OAI-SearchBot
User-agent: ChatGPT-User
User-agent: GPTBot
User-agent: PerplexityBot
User-agent: Perplexity-User
User-agent: Claude-SearchBot
User-agent: Claude-User
User-agent: ClaudeBot
User-agent: Google-Extended
Allow: /
Disallow: /styleguide/
Disallow: /admin/
Disallow: /dashboard/
Disallow: /sign/

Sitemap: https://georgecriminallawyers.com.au/sitemap.xml