technical-writer
2e90643938
sop-checklist / all-items-acked (pull_request) acked: 0/7 — missing: comprehensive-testing, local-postgres-e2e, staging-smoke, +4 — body-unfilled: 7
sop-checklist-gate / gate (pull_request_target) Successful in 4s
Secret scan / secret-scan (pull_request) Successful in 17s
CI / build (pull_request) Successful in 1m6s
- sitemap.ts: all 112 doc URLs, generated from the fumadocs source tree - robots.ts: allow-all (incl. AI answer-engine bots) + sitemap pointer - llms.txt: llmstxt.org index — product summary + 111 grouped doc links so ChatGPT/Claude/Perplexity/Gemini can discover and correctly cite the docs (GEO) Build verified (next build exit 0; all three render as static routes). Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
13 lines
482 B
TypeScript
13 lines
482 B
TypeScript
import type { MetadataRoute } from 'next';
|
|
|
|
// robots.txt — allow all crawlers (including AI answer-engine bots:
|
|
// GPTBot, ClaudeBot, PerplexityBot, Google-Extended) and point them at
|
|
// the sitemap. We *want* docs cited by LLMs (GEO), so nothing is disallowed.
|
|
export default function robots(): MetadataRoute.Robots {
|
|
return {
|
|
rules: [{ userAgent: '*', allow: '/' }],
|
|
sitemap: 'https://doc.moleculesai.app/sitemap.xml',
|
|
host: 'https://doc.moleculesai.app',
|
|
};
|
|
}
|