Crawl & Indexing
About this sectionCrawl and indexing readiness: robots.txt, XML sitemaps, crawl-budget and index permissions, redirects and 404s, duplicate-content risk and hreflang for multilingual sites.
| Checklist | Use case |
|---|---|
| hreflang Configuration Review for Multilingual Sites | Adding a second or further language version… |
| robots.txt Configuration Checks and Common Mistakes | Confirming crawl rules before a new site goes live… |
| XML Sitemap Creation, Submission and Validation | First submission of a URL list for a new site… |
| Crawl Budget and Index Permission Review for New Sites | Observing crawl behaviour in the first month after launch… |
| 404 and Redirect Configuration Review | After a site redesign or domain change… |
| Duplicate Content Risk Review | Standardising URLs before a new site launches… |
Note: this checklist is a self-check reference only. Search-engine behaviour and regulations follow the latest official documentation of each provider and jurisdiction.