We respect your privacy.

We use strictly necessary cookies to keep you signed in and to protect against CSRF. With your permission we also use a small amount of first-party analytics to improve the product. We do not sell your data and we do not use third-party advertising trackers. See our cookie policy and privacy policy .

Crawlmind
← All learn topics

Rule page.indexability.noai-meta

Review the noai / noimageai meta

page.indexability.noai-meta is a check in Crawlmind's site audit that grades medium-impact issues of this kind. This page explains why the rule matters and the exact fix.

Impact: mediumEffort: lowFixable: 1-click

Why it matters

`<meta name="robots" content="noai">` and `noimageai` are emerging signals that tell AI training crawlers (the ones building model training corpora) NOT to consume the page. They DON'T block AI-assistant fetches at answer time: Perplexity and ChatGPT-search still cite noai pages when answering a query. If you wanted to block citation, you need `robots.txt` per-bot Disallow instead.

The fix

**To block training-data crawls only (the noai meta is correct):**

```html
<meta name="robots" content="noai,noimageai">
```

**To block AI-assistant citation (different mechanism: robots.txt):**

```
User-agent: GPTBot
Disallow: /

User-agent: ClaudeBot
Disallow: /
```

Most operators don't actually want noai: they want their content cited, just not used in raw training. Confirm the intent before leaving the meta in place.

References