Tag
#Ai
32 posts tagged Ai.
E-E-A-T for AI: authorship, sourcing, dates
The three E-E-A-T signals AI engines can actually parse, and the exact markup and habits that make each one machine-legible.
Jul 03, 2026 · 5 min · Crawlmind Engineering
The cost of AI invisibility: a B2B framework
A qualitative way to reason about what your company loses when AI assistants answer buyer questions without ever mentioning you.
Jul 02, 2026 · 5 min · Crawlmind Engineering
Canonical and hreflang in an AI-answer world
Canonical and hreflang tags still shape which URL AI engines cite, but they reach the model through Bing's index and get honored unevenly.
Jul 01, 2026 · 5 min · Crawlmind Engineering
CDN caching gotchas that hide fresh content
Long TTLs, serve-stale, and Vary headers can keep your updated pages invisible to crawlers. Five CDN caching traps and how to avoid them.
Jul 01, 2026 · 5 min · Crawlmind Engineering
Most AI crawlers don't run your JavaScript
Most AI crawlers read raw HTML and never execute JavaScript, so client-rendered content can vanish from AI answers. Here is what survives.
Jun 30, 2026 · 5 min · Crawlmind Engineering
Block or allow AI crawlers: a decision guide
Whether to block or allow AI crawlers depends on one split: training bots versus search bots. A framework by business model.
Jun 30, 2026 · 5 min · Crawlmind Engineering
llms.txt explained: what belongs in it
What llms.txt is, what the spec says belongs inside it, and an honest look at whether AI engines actually read it in 2026.
Jun 30, 2026 · 4 min · Crawlmind Engineering
robots.txt for AI: partial-access patterns
How to grant some AI crawlers some paths in robots.txt, and how engines actually interpret allow, disallow, and wildcards.
Jun 30, 2026 · 5 min · Crawlmind Engineering
AI crawlers in 2026 and what each one fetches
GPTBot, ClaudeBot, PerplexityBot and Google-Extended do different jobs. Knowing which fetches what lets you allow citations and block training.
Jun 29, 2026 · 5 min · Crawlmind Engineering
FAQ schema in 2026: signal or noise
FAQ schema in 2026 no longer earns a Google SERP feature, but it still feeds AI answer engines when the Q-and-A is real.
Jun 22, 2026 · 4 min · Crawlmind Engineering
Writing for follow-up questions in AI search
AI assistants now generate the next question for the user. Content that answers the follow-up, not just the headline query, gets cited twice.
Jun 22, 2026 · 5 min · Crawlmind Engineering
How freshness signals shape AI answers
Freshness signals tell AI engines how recently a page changed. Here is what dateModified and changelog pages actually do for citations.
Jun 19, 2026 · 4 min · Crawlmind Engineering
What structured data AI engines actually read
Structured data still helps AI engines extract your facts. But the schema landscape narrowed in 2025 and 2026, so the old advice is stale.
Jun 18, 2026 · 5 min · Crawlmind Engineering
Document order beats heading level for AI
A page's heading outline is read in DOM order, not by level. Get the source order wrong and both crawlers and AI extractors misread your structure.
Jun 16, 2026 · 3 min · Crawlmind Engineering
Why your JS-rendered pages can be invisible to AI crawlers
A page can render perfectly in a browser, pass every on-page check, and still be silently de-indexed by an HTTP header your crawler never saw. Here's the X-Robots-Tag trap, why JS-rendered crawls are especially exposed to it, and how to test for it in two minutes.
Jun 15, 2026 · 4 min · Crawlmind Engineering
What "partial" AI-bot access in your robots.txt actually means
Run an AI-crawler check and you'll often see every bot marked "partial" instead of a reassuring green "allowed." That usually means your robots.txt is correct, not broken. Here's how the verdict is computed and when partial is actually a problem.
Jun 15, 2026 · 3 min · Crawlmind Engineering
Why ChatGPT cited nothing, and the one parameter that fixed it
We were tracking which domains ChatGPT cites for a query and getting zero citations back, even for questions that obviously needed fresh web data. The content wasn't the problem. One API parameter was. Here's the before/after and what it means for measuring AI visibility.
Jun 15, 2026 · 4 min · Crawlmind Engineering
Why we built Crawlmind
A short history of why a team of SEO and AI engineers ended up building an audit tool that grades sites for ChatGPT, Perplexity and Gemini instead of just Google.
May 28, 2026 · 2 min · Crawlmind Engineering
How to audit your site for AI visibility in 15 minutes
A focused 15 minute walkthrough that catches the five mistakes that quietly cost SaaS sites their AI citations. No paid tools required, runs against any live URL.
May 27, 2026 · 3 min · Crawlmind Engineering
Who actually gets cited by ChatGPT, and why
A look at the citation patterns we see when ChatGPT answers B2B SaaS queries with its browsing tool. The pattern is consistent, and the leaders are not who you'd expect from Google rankings.
May 15, 2026 · 2 min · Crawlmind Engineering
Should you block GPTBot? An honest breakdown
GPTBot has become the canary for "I take AI seriously" robots-txt edits. Almost every guide gets the analysis wrong. Here's what GPTBot actually does, and the four cases where blocking it makes sense.
May 02, 2026 · 3 min · Crawlmind Engineering
Schema markup that moves the needle for AI search
Most schema.org guides treat every type as equally important. They're not. Here's the short list of types and properties that meaningfully change whether an AI engine cites you, based on what we see across customer audits.
Apr 20, 2026 · 3 min · Crawlmind Engineering
How Perplexity decides what to cite
From watching which pages Perplexity actually cites, a few signals consistently drive the citation set. Here's what mattered, what didn't, and what changes when you optimize for it.
Apr 08, 2026 · 3 min · Crawlmind Engineering
From SEO to AEO. Rewriting your content for answer engines.
Answer Engine Optimization isn't a new acronym for the same SEO playbook. Six concrete differences in how you should write, structure, and measure content when the audience is an LLM that summarizes for a human.
Mar 25, 2026 · 3 min · Crawlmind Engineering
The new E-E-A-T. Signals AI engines look for in 2026.
Google's E-E-A-T framework was a decade old by the time LLMs adopted a version of it. The new signals overlap substantially with the old ones. Here's the rest, with the practical implications for SaaS and content sites.
Mar 12, 2026 · 3 min · Crawlmind Engineering
Why your llms.txt is probably broken (and how to tell)
Across the llms.txt files we parse in customer audits, most have at least one issue that materially reduces their usefulness to AI engines. Here are the seven most common, in order of frequency.
Feb 28, 2026 · 3 min · Crawlmind Engineering
The seven AI crawlers you should know about in 2026
A field guide to the seven crawlers that actually matter for AI search visibility right now. What each one does, the right robots-txt posture for most SaaS, and the common misconfigurations to avoid.
Feb 15, 2026 · 3 min · Crawlmind Engineering
The cost of being invisible to AI. A SaaS pricing case study.
A B2B SaaS noticed organic traffic was flat while pipeline was softer than usual. The cause was not Google. It was being absent from the AI answers their buyers were actually reading.
Feb 01, 2026 · 3 min · Crawlmind Engineering
dateModified. The most underrated SEO lever in 2026.
Most SaaS sites set dateModified once at publish time and never touch it again. The cost is real, the fix is cheap, and the trap of "fake date refresh" is worth understanding before you reach for it.
Jan 18, 2026 · 3 min · Crawlmind Engineering
Why SaaS teams need citation tracking, not rank
Rank tracking measures where Google puts you. Citation tracking measures whether ChatGPT, Perplexity and Gemini actually surface you when a buyer asks. The two metrics increasingly disagree, and only one of them predicts pipeline.
Jan 04, 2026 · 4 min · Crawlmind Engineering
Content strategy for the LLM era. Six principles that replace the old playbook.
The content playbook built for 2018 SEO doesn't survive contact with LLM answer engines. Six principles that replace the old assumptions, with the strategic and operational implications for content teams.
Dec 12, 2025 · 4 min · Crawlmind Engineering
FAQ pages still work in 2026 (if you build them right)
Google deprecated FAQ rich results in 2023. Many teams concluded FAQ markup was dead. The opposite turned out to be true for AI engines, but only if your FAQ is actually a FAQ. Here's the distinction that matters.
Nov 20, 2025 · 3 min · Crawlmind Engineering