# oldportindia.com robots.txt # Search engines and AI assistants are welcome: we want to be found, quoted and linked. # # Content-Signal (https://contentsignals.org/) says how this content may be used after it is fetched: # search = build a search index and show links and short excerpts # ai-input = use the content in live AI answers (retrieval, grounding, citations) # ai-train = use the content to train or fine-tune AI models # Content-Signal: search=yes, ai-input=yes, ai-train=no # # For agents: https://oldportindia.com/llms.txt | Markdown: add .md to any page or send "Accept: text/markdown" | MCP: https://oldportindia.com/mcp | Guide: https://oldportindia.com/agents/ User-agent: * User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: GPTBot User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: Claude-User User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: GoogleOther User-agent: Applebot User-agent: Applebot-Extended User-agent: Amazonbot User-agent: meta-externalagent User-agent: DuckAssistBot User-agent: MistralAI-User User-agent: CCBot User-agent: Googlebot User-agent: Bingbot User-agent: DuckDuckBot User-agent: YandexBot Content-Signal: search=yes, ai-input=yes, ai-train=no Allow: / Allow: /mcp Disallow: /api/ Disallow: /pilot-check/ Disallow: /search/ Disallow: /*?q= Disallow: /*?service= Disallow: /*?topic= Disallow: /*?sent= Sitemap: https://oldportindia.com/sitemap.xml