Rule llms-txt.broken-links
Fix broken links in /llms.txt
llms-txt.broken-links is a check in Crawlmind's site audit that grades high-impact issues of this kind. This page explains why the rule matters and the exact fix.
Why it matters
Your /llms.txt links to URLs that return 404 / 410 / 5xx, or to domains that don't resolve. AI engines that read llms.txt as a directory of canonical content treat the file as low-quality when its links are broken: they often skip the whole file. One broken link can take out the value of the whole index.
The fix
Check every link in `/llms.txt`:
```sh
# Quick local check: flags any non-2xx response
grep -oE "https?://[^ )]+" /path/to/llms.txt \
| xargs -I{} sh -c 'echo -n "{} "; curl -sS -o /dev/null -w "%{http_code}\n" "{}"'
```
Two failure modes:
- **Stale URL** (page moved/renamed) → update to the new canonical URL.
- **Off-host link** (`http://blog.example.com` listed in `example.com/llms.txt`) → either keep on-host only, or move the off-host link to an `## Optional` section. See `site.llms-txt.off-host-links` for the per-spec rule.
Re-validate with [llmstxt.org's parser](https://llmstxt.org) after the fix.