# Veteran Ventures Capital - robots.txt # Allow all standard crawlers User-agent: * Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /view/ Disallow: /preview/ # Explicitly allow AI search and user-directed retrieval User-agent: OAI-SearchBot Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /view/ Disallow: /preview/ User-agent: ChatGPT-User Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /view/ Disallow: /preview/ User-agent: Claude-SearchBot Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /view/ Disallow: /preview/ User-agent: Claude-User Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /view/ Disallow: /preview/ User-agent: PerplexityBot Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /view/ Disallow: /preview/ # Allow model-development and grounding crawlers on public content User-agent: GPTBot Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /view/ Disallow: /preview/ User-agent: ClaudeBot Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /view/ Disallow: /preview/ User-agent: Anthropic-AI Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /view/ Disallow: /preview/ User-agent: Google-Extended Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /view/ Disallow: /preview/ # Other public-web discovery crawlers User-agent: Bytespider Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /view/ Disallow: /preview/ User-agent: CCBot Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /view/ Disallow: /preview/ # Sitemap Sitemap: https://veteranventures.us/sitemap.xml # AI Discoverability # llms.txt: https://veteranventures.us/llms.txt # llms-full.txt: https://veteranventures.us/llms-full.txt # Content Signal (Cloudflare convention) # Matches the explicit policy above: public content may support search, # live AI answers, grounding, and model development. Content-Signal: search=yes, ai-input=yes, ai-train=yes