# FleckTech Solutions LLC — crawler access policy # Canonical main site: https://flecktechsolutions.com # AI-readable site guide: https://flecktechsolutions.com/llms.txt # # Direct-use operational routes are intentionally excluded from crawl discovery. # They must also use page-level noindex controls or access restrictions when # they should not appear in search results. User-agent: * Allow: / Disallow: /connect Disallow: /book-appointment Disallow: /existing-clients Disallow: /thank-you Disallow: /pmt-thank-you Disallow: /doc-thank-you Disallow: /over-50-fair # Major AI search, retrieval, and user-requested agents. # These named agents receive the same protected-route restrictions as User-agent: *. User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: PerplexityBot User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: Claude-User User-agent: anthropic-ai User-agent: Google-Extended User-agent: bingbot User-agent: BingPreview User-agent: Applebot User-agent: CCBot Allow: / Disallow: /connect Disallow: /book-appointment Disallow: /existing-clients Disallow: /thank-you Disallow: /pmt-thank-you Disallow: /doc-thank-you Disallow: /over-50-fair # Search and social-preview crawlers receive the same protected-route restrictions. User-agent: Googlebot User-agent: Twitterbot User-agent: facebookexternalhit User-agent: LinkedInBot User-agent: Slackbot-LinkExpanding Allow: / Disallow: /connect Disallow: /book-appointment Disallow: /existing-clients Disallow: /thank-you Disallow: /pmt-thank-you Disallow: /doc-thank-you Disallow: /over-50-fair Sitemap: https://flecktechsolutions.com/sitemap.xml