cipher/public/robots.txt
King Omar 5d41ed72f4 Add SEO: sitemap.xml, robots.txt, meta tags + structured data
- sitemap.xml (homepage) + robots.txt (allow crawl, disallow /api/, link sitemap)
- <head>: SEO title, meta description, keywords, canonical, robots
- Open Graph + Twitter Card tags for link previews
- JSON-LD WebApplication structured data (features, free, publisher)
- <noscript> crawlable content so the JS-rendered SPA has indexable text
- SW cache v11

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-22 19:50:35 +10:00

7 lines
259 B
Text

# Cipher — allow crawling of the public app shell; keep the API out of the index.
# JS/CSS are intentionally crawlable so Google can render the single-page app.
User-agent: *
Allow: /
Disallow: /api/
Sitemap: https://cipher.theradicalparty.com/sitemap.xml