Why it matters
A page that is not indexed cannot appear in results. Crawling, rendering and indexing are separate steps, so a fetched page may still be left out.
Where you will see it
You will mostly meet this term in website audit reports and in the guides listed alongside this page. The free website audit runs the checks that relate to it and ranks what to fix first.
Related terms
- noindex: A directive, set in a robots meta tag or an X-Robots-Tag HTTP header, that asks search engines not to include a page in their results.
- robots.txt: A plain-text file at the root of a site that tells crawlers which paths they may crawl.
- XML sitemap: A file that lists the URLs you want search engines to know about, optionally with last-modified dates.
Go deeper
- robots.txt explained: What robots.txt does and does not do, how Allow and Disallow rules are matched, the mistakes that hide sites from search, and how to handle AI crawlers.
- XML sitemaps: How an XML sitemap works, its format and limits, which URLs belong in it, the common mistakes that make search engines ignore it, and how to check yours.