Search Indexing (Sitemap & Robots)
How dynamic sitemap.xml and robots.txt work, and how to submit them to search engines.
ProfilePilot now serves a dynamic sitemap at /sitemap.xml and a robots file at /robots.txt.
The sitemap includes key marketing pages plus all published blog articles from /blog/[slug].
Newly published blog posts are discovered automatically without manual XML edits.
The robots file allows public pages and blocks private sections like /dashboard, /api, /auth, onboarding routes, and invite flows.
Robots also points crawlers to /sitemap.xml so search engines can fetch the latest URL inventory.
Submit your sitemap URL directly in Google Search Console and Bing Webmaster Tools to speed up discovery and indexing status visibility.
If your primary domain changes, update NEXT_PUBLIC_SITE_URL (or NEXT_PUBLIC_APP_URL fallback) so sitemap and robots output the correct host.
- Open /robots.txt and verify the sitemap URL is correct
- Open /sitemap.xml and confirm published blog article URLs are listed
- Submit https://your-domain/sitemap.xml in Google Search Console
- Submit https://your-domain/sitemap.xml in Bing Webmaster Tools
- Recheck sitemap output after publishing new blog content
AI answers may be approximate. Verify critical steps in official docs above.