User-agent: Googlebot Disallow: /api/ Disallow: /_vercel/ Allow: /_vercel/image User-agent: Googlebot-Image Disallow: /api/ Disallow: /_vercel/ Allow: /_vercel/image User-agent: Mediapartners-Google Disallow: /api/ User-agent: GPTBot Disallow: /api/ Disallow: /admin/ Disallow: /private/ Allow: / Allow: /.well-known/ User-agent: OAI-SearchBot Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: ChatGPT-User Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: Claude-Web Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: ClaudeBot Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: anthropic-ai Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: PerplexityBot Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: Google-Extended Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: Brave-Search Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: cohere-ai Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: Amazonbot Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: Meta-ExternalAgent Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: Meta-ExternalFetcher Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: Bytespider Disallow: /api/ Disallow: /admin/ User-agent: CCBot Disallow: /api/ Disallow: /admin/ Allow: / User-agent: ia_archiver Disallow: /api/ Disallow: /admin/ Allow: / User-agent: bingbot Disallow: /api/ Disallow: /_vercel/ Allow: /_vercel/image Allow: / Allow: /.well-known/ User-agent: Applebot Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: DuckDuckBot Disallow: /api/ Allow: / User-agent: Yandex Disallow: /api/ Disallow: /admin/ User-agent: Baiduspider Disallow: /api/ Disallow: /admin/ User-agent: facebookexternalhit Disallow: /api/ Disallow: /admin/ User-agent: Twitterbot Disallow: /api/ User-agent: LinkedInBot Disallow: /api/ User-agent: WhatsApp Disallow: /api/ User-agent: Slackbot Disallow: /api/ User-agent: Discordbot Disallow: /api/ User-agent: TelegramBot Disallow: /api/ User-agent: AhrefsBot Allow: / User-agent: SemrushBot Allow: / User-agent: MJ12bot Allow: / User-agent: DotBot Allow: / User-agent: Claude-SearchBot Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: AzureAI-SearchBot Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: ExaBot Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: YouBot Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: PhindBot Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: DuckAssistBot Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: PetalBot Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: LinkupBot Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: Cloudflare-AutoRAG Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: Amzn-SearchBot Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: meta-webindexer Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: AddSearchBot Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: Channel3Bot Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: ZanistaBot Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: Claude-User Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: Perplexity-User Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: MistralAI-User Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: Gemini-Deep-Research Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: Google-NotebookLM Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: kagi-fetcher Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: LinerBot Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: Devin Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: Applebot-Extended Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: Google-CloudVertexBot Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: GoogleOther Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: cohere-training-data-crawler Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: Diffbot Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: PanguBot Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: FirecrawlAgent Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: AmazonBuyForMe Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: Manus-User Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: NovaAct Disallow: /api/ Disallow: /admin/ Allow: / Allow: /.well-known/ User-agent: * Disallow: /api/ Disallow: /admin/ Disallow: /_vercel/ Allow: /_vercel/image Allow: /.well-known/mcp.json Sitemap: https://www.flyweel.co/sitemap-index.xml Sitemap: https://www.flyweel.co/image-sitemap.xml Sitemap: https://www.flyweel.co/docs/sitemap-index.xml