From 720a5a1dd27ed7c9b6a7947fa639d7708f72736d Mon Sep 17 00:00:00 2001 From: David Montero Date: Sat, 15 Aug 2026 05:57:04 +0200 Subject: [PATCH] chore(seo): declare the docs portal sitemap in robots.txt MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit velxio.dev/docs/ ships its own Astro sitemap-index (2142 URLs) but nothing referenced it — the main sitemap dropped the retired in-app /docs entries on purpose (df19778a) and robots.txt only listed the app + projects sitemaps, so crawlers had no discovery path to the new portal. --- frontend/public/robots.txt | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/frontend/public/robots.txt b/frontend/public/robots.txt index 7c3fee42..261bfa5d 100644 --- a/frontend/public/robots.txt +++ b/frontend/public/robots.txt @@ -13,6 +13,8 @@ Disallow: /admin # Prevent crawling of API endpoints Disallow: /api/ -# Sitemap (static build-time routes + dynamic public projects) +# Sitemaps (static build-time routes + dynamic public projects + the docs +# portal, which is a separate Astro build shipping its own sitemap index) Sitemap: https://velxio.dev/sitemap.xml Sitemap: https://velxio.dev/sitemap-projects.xml +Sitemap: https://velxio.dev/docs/sitemap-index.xml