We respect your privacy.

We use strictly necessary cookies to keep you signed in and to protect against CSRF. With your permission we also use a small amount of first-party analytics to improve the product. We do not sell your data and we do not use third-party advertising trackers. See our cookie policy and privacy policy .

← All learn topics

Rule site.llms-txt.off-host-links

Move off-host links to the Optional section of /llms.txt

site.llms-txt.off-host-links is a check in Crawlmind's site audit that grades medium-impact issues of this kind. This page explains why the rule matters and the exact fix.

Impact: mediumEffort: lowFixable: 1-click

Why it matters

The llmstxt.org spec is clear that links in the main body should be on the same host as the `/llms.txt` file. Off-host links (your CDN, a subdomain doc site, a GitHub repo) belong in an `## Optional` section if anywhere. Most AI engines either ignore off-host links in the main body or penalise the file for spec violation.

The fix

Before (off-host in the main body):

```markdown
## Core

- [Docs](https://docs.example.com/getting-started)
- [Blog](https://blog.example.com)
- [GitHub](https://github.com/example/repo)
```

After (on-host in Core, off-host in Optional):

```markdown
## Core

- [Getting started](https://example.com/getting-started)
- [Pricing](https://example.com/pricing)

## Optional

- [Documentation](https://docs.example.com)
- [Engineering blog](https://blog.example.com)
- [Open source](https://github.com/example/repo)
```

If a subdomain hosts your canonical pages (a separate docs site, for example), generate that subdomain's own `/llms.txt` rather than cramming everything into the root.

References