User-agent: * Disallow: /pricing/checkout/ Allow: / Disallow: /admin/ # UI-state / funnel params. These appear on URLs via internal links # (pricing CTAs, login redirects, checkout, converter result hand-off) # but never change indexable body content. Block to save crawl budget # and prevent param-variant duplicates being catalogued. Disallow: /*?ref= Disallow: /*&ref= Disallow: /*?next= Disallow: /*&next= Disallow: /*?plan= Disallow: /*&plan= Disallow: /*?from_result= Disallow: /*&from_result= Disallow: /*?q= Disallow: /*&q= # Note: ?lang= is intentionally NOT blocked. StripUnsupportedLang # middleware 301s ?lang=en and below-threshold langs to the bare # canonical; indexable languages need their ?lang= alternates crawlable. # Clicky first-party analytics beacon (proxied, same-origin). Googlebot # re-crawls /4fadbcc3a30dc?site_id=... + loader as junk 200s — crawl-budget waste # (~49% of refresh re-crawls on free.ai). Crawl directive only; analytics # unaffected (browsers still fire it). See ~/seo/playbook/06. Disallow: /4fadbcc3a30dc Disallow: /5bd1c60b79f.js Sitemap: https://mp3.to/sitemap.xml