We respect your privacy.

We use strictly necessary cookies to keep you signed in and to protect against CSRF. With your permission we also use a small amount of first-party analytics to improve the product. We do not sell your data and we do not use third-party advertising trackers. See our cookie policy and privacy policy .

← All learn topics

Rule page.indexability.x-robots-noindex

Audit the X-Robots-Tag: noindex response header

page.indexability.x-robots-noindex is a check in Crawlmind's site audit that grades high-impact issues of this kind. This page explains why the rule matters and the exact fix.

Impact: highEffort: low

Why it matters

The server returned `X-Robots-Tag: noindex` for this URL. The header has the same effect as the meta tag but is invisible in the HTML: operators frequently set it in nginx/Caddy/Cloudflare config and then forget it's there. If the page should be indexable, the header is overriding the in-HTML allow.

The fix

Find it in your server config:

```nginx
# nginx example: removes the noindex for the public docs path
location /docs/ {
    add_header X-Robots-Tag "" always;
}
```

```caddy
# Caddy: remove the header globally for paths that should index
header /docs/* X-Robots-Tag ""
```

Cloudflare: check Transform Rules → Modify Response Header.
Vercel/Netlify: check the `headers` config in your project.

Then re-fetch via `curl -I` to confirm the header is gone.

References