When not to use an indexer

What an indexer actually does

An indexer increases the chance and speed of Googlebot crawling a URL. After the crawl, Google decides on its own whether to store the page. The gap between crawling and indexing is the reason this page exists: in every case below, crawling either can't lead to indexing or isn't the problem.

IndexChex, the publisher of this site, says the same in its refund policy: it guarantees crawling, not indexing, and credits are not refunded for URLs Google declines. That makes pre-submission filtering a direct cost saving.

Pages Google is told not to index

• noindex. Google's noindex documentation states that a page with the rule is dropped from results when Googlebot next crawls it. Submitting it only speeds up the removal. Check both the meta tag and the X-Robots-Tag header.
• Blocked by robots.txt. If Googlebot can't fetch the page, it can't read the content. The same documentation notes that a noindex rule behind a robots.txt block won't even be seen.
• Canonicalized elsewhere. A page whose canonical points at another URL is asking Google to index that other URL. Google's duplicate URL guidance treats the canonical as a strong signal.

Pages that aren't really pages

• Redirects (submit the destination instead).
• 404, 410 and server errors.
• Login walls and pages that render empty without JavaScript Google can't execute.

Pages Google is likely to decline

Thin pages. Bare profiles, empty tag archives, placeholder product pages and one-paragraph web 2.0 posts. These are often crawled and left in the state Search Console calls crawled, currently not indexed.

Duplicates. Spun articles, syndicated copies without a canonical, product pages with manufacturer text shared across many stores, and programmatic pages that differ by a single word.

Spam. Google's spam policies cover link schemes, scaled content abuse and other practices. Making spam pages visible does not change their classification; it may simply bring them to the attention of the systems that demote them. If a link would be a problem in a manual review, paying to surface it is not a neutral act.

IndexChex's weekly measurements on recurring URL sets show standard mode averaging 85%+ indexation for typical sites, links and citations as of October 2026. The pages above are the ones that pull a real batch below that average.

Owned pages that are already fine

For a site you control, the native route is sitemaps, internal links and occasional URL Inspection requests. Google's recrawl guide describes these. If new pages on your site routinely appear within a day or two, an indexer changes little. It earns its cost on new domains, time-sensitive pages and deep URLs that stay undiscovered; see indexing new blog posts.

A pre-submission filter

Running an index check before submission catches the last row and avoids paying twice for URLs Google already has.

When it is the right tool

Indexers suit legitimate placements on sites you don't control: guest posts, citations, press pickups and niche edits that are real pages with real content. That use case is covered in indexing guest post backlinks. Agencies that build this filter into intake avoid billing clients for unindexable URLs; link indexing for agencies describes that process. Related cautions apply to tier 2 links and programmatic pages.