We respect your privacy.

We use strictly necessary cookies to keep you signed in and to protect against CSRF. With your permission we also use a small amount of first-party analytics to improve the product. We do not sell your data and we do not use third-party advertising trackers. See our cookie policy and privacy policy .

Crawlmind
Score another site

Scorecard for

nytimes.com

66

/ 100 overall

Completed 5/18/2026, 8:14:22 PM

Room to improve

We checked 3 pages on nytimes.com. Want every page audited? Run the full crawl free .

By dimension

Technical SEO

90

Structured data

100

AI crawler access

0

LLM readability

40

Performance

100

What we found

  • CRITICAL

    6 AI crawler(s) blocked

    Blocked: Applebot-Extended, CCBot, ClaudeBot, Google-Extended, GPTBot, PerplexityBot. Many teams block these by accident — see /docs/ai-bots/gptbot.

  • MEDIUM

    Meta description off length

    Description is 267 characters. Aim for 120–155.

  • MEDIUM

    No llms.txt at /llms.txt

    llms.txt is the emerging convention that tells AI engines what to read first. Add one with the /tools/llms-txt generator.

Want this for every page?

Full audit, every issue, ranked by impact. Free plan covers 5 crawls a month and up to 10 pages each.

Run the full audit
Embed this badge on nytimes.com

Paste this HTML wherever you want a live scorecard badge. Updates every 7 days. 

<a href="https://crawlmind.ai/scorecard/nytimes.com">
  <img src="https://crawlmind.ai/embed/nytimes.com.svg" alt="Crawlmind score" />
</a>