User-agent: * Allow: / # AI Crawlers — explicitly allowed on all public routes User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: anthropic-ai Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: PerplexityBot Allow: / User-agent: Googlebot-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: CCBot Allow: / User-agent: cohere-ai Allow: / # Private / authenticated routes — do not index Disallow: /dashboard Disallow: /login Disallow: /orguser/ Disallow: /admin/ Disallow: /orgadmin/ Disallow: /agentDashboard Disallow: /agentForgetpass Disallow: /agentreset/ Disallow: /testcases Disallow: /testcaseshistory Disallow: /gherkinhistory Disallow: /apiautomation Disallow: /uiautomation Disallow: /execution Disallow: /form Disallow: /globalvariable Disallow: /authorization Disallow: /suitehistory Disallow: /testcaseeditor Disallow: /notification Disallow: /redeemoffer Disallow: /admincarousels Disallow: /agentmanagement Disallow: /ReferNEarn Disallow: /scenariosTraditional/ Disallow: /scenariosGherkin/ Disallow: /TraditionalHistory/ Disallow: /GherkinHistory/ Disallow: /paymentsubscription Disallow: /billingHistory Disallow: /contactus Disallow: /reportabug Disallow: /userdashboard Disallow: /dashboardpassword Disallow: /dashboardpersonaldetails # Public but deliberately not indexed: thin/utility pages that are not in # sitemap.xml. Without these lines the SPA fallback answers them with HTTP 200, # which Google files as a soft 404 against the whole site. Disallow: /homereportabug Disallow: /HomeReportABug Disallow: /stakeholder-response Disallow: /forgotpassword Disallow: /contactsale Disallow: /parternModel Disallow: /testExecutionResult/ Disallow: /apiDashboard Sitemap: https://qaeverest.ai/sitemap.xml