You publish a page, search for it on Google a week later, and it is nowhere to be found. Before you start tweaking keywords, check one thing first: is the page even in Google’s index? If it is not, no amount of optimisation will help.
Crawling, Indexing And Ranking Are Different Things
People mix these up all the time, and the difference matters when you are troubleshooting.
- Crawling is when Googlebot visits a URL and reads what is on it.
- Indexing is when Google processes that page and stores it in its database so it can be shown in results.
- Ranking is where an indexed page appears for a particular search.
A page can be crawled but not indexed. It can also be indexed and still rank on page ten. Each stage has its own causes, so work out which one is failing before you start fixing things.
How To Check If A Page Is Indexed
The quickest test is a site: search. Type site:yourdomain.com/page-url into Google. If the page appears, it is indexed. If nothing shows, it probably is not. It is a rough check, not a perfect one, so use it as a first look.
The more reliable method is the URL Inspection tool in Google Search Console. Paste the full URL in the top bar and it tells you whether the page is on Google, when it was last crawled, which canonical Google chose and whether anything is blocking it. If it says “URL is not on Google”, it gives a reason.
For a wider view, open the Pages report in Search Console. It lists indexed and non-indexed URLs with the reason for each, such as “Crawled – currently not indexed” or “Excluded by noindex tag”.
Common Reasons Pages Are Not Indexed
These are the ones we find most often when we audit a site:
- A noindex tag. Often left behind after a site was built on a staging copy, or switched on by an SEO plugin setting. In WordPress, check Settings, then Reading, for “Discourage search engines from indexing this site”.
- Blocked by robots.txt. A stray Disallow: / line stops Googlebot from crawling the site at all.
- Thin or duplicate content. Pages with very little useful text, or near-copies of other pages, are often crawled and then left out.
- No internal links. If nothing on your site links to a page, Google may never find it, or may treat it as unimportant.
- Canonical pointing elsewhere. The page tells Google another URL is the main version.
- Server errors or redirects. Pages returning 404 or 5xx errors cannot be indexed.
Submit A Sitemap And Request Indexing
An XML sitemap lists the pages you want Google to know about. Most SEO plugins, such as Yoast or Rank Math, create one automatically at /sitemap_index.xml. Submit it under Sitemaps in Search Console and check that the number of discovered URLs looks right.
For a single new or updated page, use URL Inspection and click Request indexing. This is a nudge, not a guarantee. Google decides what to index based on quality and need, and some pages simply wait.
What To Do If A Page Stays Out
Work through the list above in order. Remove blocks, strengthen the content so it adds something new, add links from relevant pages, and then request indexing again. If a page is not worth indexing, such as a thank-you page or filtered duplicate, leaving it out is correct.
Give it a couple of weeks after fixing issues. If it still does not appear, the content probably needs more value rather than more technical changes.
Stuck with pages Google will not pick up? Our SEO services include a full indexing check, and you can contact us to get started.
