Rule llms-txt.missing
Publish an /llms.txt
llms-txt.missing is a check in Crawlmind's site audit that grades medium-impact issues of this kind. This page explains why the rule matters and the exact fix.
Why it matters
llms.txt is the emerging convention for telling AI assistants which URLs on your site are worth reading: analogous to robots.txt for crawlers and sitemap.xml for search engines. It's a plain-markdown file at /llms.txt that lists your key sections (docs, blog, pricing) with short descriptions. Cost: 10 minutes. Benefit: AI engines that respect it skip the bloat and key off your declared canonical pages.
The fix
Use the **llms.txt** tab in the dashboard to download an auto-generated starter from your sitemap, then publish it at `/llms.txt`. Minimal hand-written form:
```
# Brand Name
> One-line description of what your site does.
## Docs
- [Quickstart](https://example.com/docs/quickstart): install in 5 min
- [API reference](https://example.com/docs/api): REST + webhooks
## Pricing
- [Pricing](https://example.com/pricing): plans and FAQ
```