Softonic

Indexability Checker

Step 1 / 3 Check Indexability
Next

A page can be perfectly good but invisible to search because a single tag says “noindex” or robots.txt blocks the crawler. Paste a URL and this checker evaluates every signal Google uses, robots.txt, meta robots, X-Robots-Tag header, canonical target, HTTP status, and tells you whether the page is indexable, why, and what to change if not.

How to check indexability

  1. 1

    Enter a URL

    The checker fetches the URL as Googlebot would.

  2. 2

    It resolves redirects

    A chain of 301/302 hops is traced; the final URL is the one evaluated.

  3. 3

    It reads every indexability signal

    robots.txt rules, meta robots, X-Robots-Tag, canonical, status code.

  4. 4

    Verdict and reason

    Indexable / not indexable / partial, with the exact signal that caused the verdict.

Indexability signals and their precedence

Google evaluates a set of signals in a specific order; a single negative in the chain is enough to block indexing.

Signal evaluation order

  1. HTTP status: 2xx required. 3xx chains are followed; 4xx and 5xx end indexing.
  2. robots.txt: if the URL is disallowed for Googlebot, the page is never crawled, which means noindex tags on it are never seen.
  3. X-Robots-Tag header: noindex in the HTTP response headers blocks indexing.
  4. Meta robots: <meta name="robots" content="noindex"> blocks indexing.
  5. Canonical: a canonical pointing elsewhere means Google indexes that other URL instead.
  6. Content quality and duplicate detection: Google may skip indexing even without explicit directives.

Common mistakes this catches

Problem Cause
Whole section not indexed Disallow: rule in robots.txt
Specific page not indexed noindex in meta robots
Indexed with wrong URL Canonical points somewhere else
Stuck at 5xx Server error breaks crawl
Disallow + noindex conflict Robots.txt blocks crawl, noindex tag never read
Staging leaks to production X-Robots-Tag: noindex leftover from a test environment

The robots.txt + noindex trap

If you Disallow: a URL in robots.txt, Google never crawls it, so it never sees any noindex tag. The URL may still appear in search results as a “blank” entry with only the URL and no description. To remove a URL from the index properly, allow crawling and use noindex, then block crawling only after Google has de-indexed it.

Testing from Googlebot perspective

The checker sends the Googlebot user agent so any server-side “crawlers only see X” tricks are visible. Always verify production URLs, not staging.

Frequently Asked Questions

Being indexable only means there is no technical block; it does not guarantee indexing. Google also decides based on perceived quality, duplicate content and crawl budget. Use Search Console’s URL Inspection for a definitive answer from Google itself.

Usually just meta robots (or X-Robots-Tag) is the right answer. Robots.txt blocks crawling; meta robots blocks indexing. For pages you do not want indexed, allow crawling so Google can read your noindex tag.

Google evaluates the final destination of a redirect chain. A 301 from A to B means Google ultimately indexes B, not A. The checker simulates this by resolving all redirects before evaluating.

No. Pages that require authentication are not indexable by definition. If you need SEO for them, consider a public preview version.

Related Tools

Meta Description Length Checker

Measure a meta description in characters and estimated pixels, compare editorial ranges, and inspect illustrative desktop and mobile previews.

Canonical Tag Generator

Generate a valid rel=canonical link tag for any URL. Includes URL validation and the common mistakes to avoid.

HTTP Security Headers Checker

Paste HTTP response headers and review HSTS, CSP, clickjacking, MIME, referrer and cross-origin policies locally in your browser.

Google SERP Simulator

Preview an approximate Google-style search snippet with character limits for mobile and desktop. Your draft stays in this browser session.

XML Sitemap Validator

Check sitemap XML in your browser for parse errors, missing locations, duplicate URLs, and common sitemap field values.

Broken Link Checker

Paste a page URL and check its outbound links for 404s and other HTTP errors, with the status code for each link.

Tool available in other languages