User-agent: * Allow: / Sitemap: https://123mybot.com/sitemap.xml # Block dashboard and API from crawling Disallow: /dashboard/ Disallow: /api/ Disallow: /embed.js