New posts, no spam. Roughly monthly. Unsubscribe with one click.
The click gap: what AI Overviews cost you
When an AI summary appears, organic clicks fall by half. Here is what the click gap means for how you plan and measure content.
Jul 06, 2026 · 5 min · Crawlmind Engineering
Query fan-out: answer the hidden queries
Google's AI Mode splits one question into many hidden sub-queries. Miss them and your page earns no citation. How to map and cover the fan-out.
Jul 06, 2026 · 4 min · Crawlmind Engineering
Why AI cites Reddit more than your site
User-generated forums outrank most brand pages in AI answers. Here is why, and the two-part strategy that actually works.
Jul 06, 2026 · 4 min · Crawlmind Engineering
From SEO reporting to GEO reporting
What breaks when you point an SEO dashboard at AI answers, and the metrics you add so the numbers mean something again.
Jul 05, 2026 · 5 min · Crawlmind Engineering
How to brief writers for GEO
A content brief that pushes writers toward citable answers instead of keyword density, so posts get quoted by AI engines.
Jul 03, 2026 · 5 min · Crawlmind Engineering
E-E-A-T for AI: authorship, sourcing, dates
The three E-E-A-T signals AI engines can actually parse, and the exact markup and habits that make each one machine-legible.
Jul 03, 2026 · 5 min · Crawlmind Engineering
The cost of AI invisibility: a B2B framework
A qualitative way to reason about what your company loses when AI assistants answer buyer questions without ever mentioning you.
Jul 02, 2026 · 5 min · Crawlmind Engineering
Share of citation: the new share of voice
Share of citation measures how often AI answers name your brand. Here is why it is replacing share of voice as the metric that predicts growth.
Jul 02, 2026 · 5 min · Crawlmind Engineering
A repeatable AI-visibility content audit
A repeatable checklist for auditing whether AI assistants can find, read, and cite your pages, from crawler access to per-platform tracking.
Jul 01, 2026 · 5 min · Crawlmind Engineering
Canonical and hreflang in an AI-answer world
Canonical and hreflang tags still shape which URL AI engines cite, but they reach the model through Bing's index and get honored unevenly.
Jul 01, 2026 · 5 min · Crawlmind Engineering
CDN caching gotchas that hide fresh content
Long TTLs, serve-stale, and Vary headers can keep your updated pages invisible to crawlers. Five CDN caching traps and how to avoid them.
Jul 01, 2026 · 5 min · Crawlmind Engineering
Most AI crawlers don't run your JavaScript
Most AI crawlers read raw HTML and never execute JavaScript, so client-rendered content can vanish from AI answers. Here is what survives.
Jun 30, 2026 · 5 min · Crawlmind Engineering
Block or allow AI crawlers: a decision guide
Whether to block or allow AI crawlers depends on one split: training bots versus search bots. A framework by business model.
Jun 30, 2026 · 5 min · Crawlmind Engineering
llms.txt explained: what belongs in it
What llms.txt is, what the spec says belongs inside it, and an honest look at whether AI engines actually read it in 2026.
Jun 30, 2026 · 4 min · Crawlmind Engineering
robots.txt for AI: partial-access patterns
How to grant some AI crawlers some paths in robots.txt, and how engines actually interpret allow, disallow, and wildcards.
Jun 30, 2026 · 5 min · Crawlmind Engineering
AI crawlers in 2026 and what each one fetches
GPTBot, ClaudeBot, PerplexityBot and Google-Extended do different jobs. Knowing which fetches what lets you allow citations and block training.
Jun 29, 2026 · 5 min · Crawlmind Engineering
Answer-engine-ready docs, without dumbing down
Making documentation quotable by AI assistants is a structure problem, not a reading-level problem. Here is how to do it without cutting depth.
Jun 29, 2026 · 5 min · Crawlmind Engineering
The atomic-answer pattern for AI citations
One question, one paragraph, one citable claim. The atomic-answer pattern is how you write content that AI engines can extract and quote cleanly.
Jun 29, 2026 · 5 min · Crawlmind Engineering
How answer engines deduplicate sources
Answer engines collapse many pages that say the same thing into one citation. Being the original, or adding new information, is how you survive the cut.
Jun 29, 2026 · 5 min · Crawlmind Engineering
Map the question space before you write
Cover a topic's long-tail question space before drafting, so your page answers the specific queries AI engines actually pull from.
Jun 29, 2026 · 4 min · Crawlmind Engineering
When AI engines prefer tables over prose
AI engines reach for a table when the question is a comparison or a lookup. Here is when to use one and how to format it so the model can read it.
Jun 29, 2026 · 5 min · Crawlmind Engineering
Entity clarity: be legible to AI engines
Entity clarity is making your brand resolve to one consistent thing AI engines can recognize, name, and cite.
Jun 22, 2026 · 5 min · Crawlmind Engineering
FAQ schema in 2026: signal or noise
FAQ schema in 2026 no longer earns a Google SERP feature, but it still feeds AI answer engines when the Q-and-A is real.
Jun 22, 2026 · 4 min · Crawlmind Engineering
Writing for follow-up questions in AI search
AI assistants now generate the next question for the user. Content that answers the follow-up, not just the headline query, gets cited twice.
Jun 22, 2026 · 5 min · Crawlmind Engineering
Why comparison pages win AI citations
Comparison and X vs Y pages match how buyers ask AI tools at decision time, which is why they earn citations. Here is how to build them.
Jun 20, 2026 · 5 min · Crawlmind Engineering
How freshness signals shape AI answers
Freshness signals tell AI engines how recently a page changed. Here is what dateModified and changelog pages actually do for citations.
Jun 19, 2026 · 4 min · Crawlmind Engineering
GEO vs AEO vs SEO: one funnel, three layers
GEO, AEO, and SEO are three optimization layers on one funnel. Here is how they differ, where they overlap, and how to stack them.
Jun 19, 2026 · 5 min · Crawlmind Engineering
Why answer-first structure wins AI citations
AI engines quote the part of your page that answers the question. Put that answer first and you get cited more often.
Jun 18, 2026 · 5 min · Crawlmind Engineering
Making a SaaS feature page quotable by AI
Product pages win AI citations at buying intent but lose at the research stage. Here is how to make a SaaS feature page liftable into an answer.
Jun 18, 2026 · 5 min · Crawlmind Engineering
How to measure GEO with citation share
Citation share is the percentage of AI answers on your topic that cite your site. Here is how to define it and track it.
Jun 18, 2026 · 5 min · Crawlmind Engineering
What structured data AI engines actually read
Structured data still helps AI engines extract your facts. But the schema landscape narrowed in 2025 and 2026, so the old advice is stale.
Jun 18, 2026 · 5 min · Crawlmind Engineering
The anatomy of an AI citation
What ChatGPT, Perplexity, and Gemini actually quote from a page, and the page traits that decide whether you are the source they lift.
Jun 17, 2026 · 5 min · Crawlmind Engineering
What is GEO, and how it differs from SEO
Generative Engine Optimization is structuring content so AI answer engines cite it. Where the term came from, what it means, and how it diverges from SEO.
Jun 17, 2026 · 4 min · Crawlmind Engineering
Document order beats heading level for AI
A page's heading outline is read in DOM order, not by level. Get the source order wrong and both crawlers and AI extractors misread your structure.
Jun 16, 2026 · 3 min · Crawlmind Engineering
Why Google reports 404s for URLs you never created
Search Console flags a /cdn-cgi/l/email-protection 404 you never built. It's Cloudflare rewriting your emails. Here's the cause and the one-line fix.
Jun 16, 2026 · 3 min · Crawlmind Engineering
Your robots.txt change isn't live yet
You edited robots.txt, deployed, and crawlers still see the old rules. robots.txt is edge-cached, often for hours. Here's how to confirm and force it live.
Jun 16, 2026 · 3 min · Crawlmind Engineering
Why your JS-rendered pages can be invisible to AI crawlers
A page can render perfectly in a browser, pass every on-page check, and still be silently de-indexed by an HTTP header your crawler never saw. Here's the X-Robots-Tag trap, why JS-rendered crawls are especially exposed to it, and how to test for it in two minutes.
Jun 15, 2026 · 4 min · Crawlmind Engineering
What "partial" AI-bot access in your robots.txt actually means
Run an AI-crawler check and you'll often see every bot marked "partial" instead of a reassuring green "allowed." That usually means your robots.txt is correct, not broken. Here's how the verdict is computed and when partial is actually a problem.
Jun 15, 2026 · 3 min · Crawlmind Engineering
Why ChatGPT cited nothing, and the one parameter that fixed it
We were tracking which domains ChatGPT cites for a query and getting zero citations back, even for questions that obviously needed fresh web data. The content wasn't the problem. One API parameter was. Here's the before/after and what it means for measuring AI visibility.
Jun 15, 2026 · 4 min · Crawlmind Engineering
What we ship and why
A short note on the cadence we hold and the kinds of posts you'll find here.
Jun 01, 2026 · 1 min · Crawlmind Engineering
Why we built Crawlmind
A short history of why a team of SEO and AI engineers ended up building an audit tool that grades sites for ChatGPT, Perplexity and Gemini instead of just Google.
May 28, 2026 · 2 min · Crawlmind Engineering
How to audit your site for AI visibility in 15 minutes
A focused 15 minute walkthrough that catches the five mistakes that quietly cost SaaS sites their AI citations. No paid tools required, runs against any live URL.
May 27, 2026 · 3 min · Crawlmind Engineering
Who actually gets cited by ChatGPT, and why
A look at the citation patterns we see when ChatGPT answers B2B SaaS queries with its browsing tool. The pattern is consistent, and the leaders are not who you'd expect from Google rankings.
May 15, 2026 · 2 min · Crawlmind Engineering
Should you block GPTBot? An honest breakdown
GPTBot has become the canary for "I take AI seriously" robots-txt edits. Almost every guide gets the analysis wrong. Here's what GPTBot actually does, and the four cases where blocking it makes sense.
May 02, 2026 · 3 min · Crawlmind Engineering
Schema markup that moves the needle for AI search
Most schema.org guides treat every type as equally important. They're not. Here's the short list of types and properties that meaningfully change whether an AI engine cites you, based on what we see across customer audits.
Apr 20, 2026 · 3 min · Crawlmind Engineering
How Perplexity decides what to cite
From watching which pages Perplexity actually cites, a few signals consistently drive the citation set. Here's what mattered, what didn't, and what changes when you optimize for it.
Apr 08, 2026 · 3 min · Crawlmind Engineering
From SEO to AEO. Rewriting your content for answer engines.
Answer Engine Optimization isn't a new acronym for the same SEO playbook. Six concrete differences in how you should write, structure, and measure content when the audience is an LLM that summarizes for a human.
Mar 25, 2026 · 3 min · Crawlmind Engineering
The new E-E-A-T. Signals AI engines look for in 2026.
Google's E-E-A-T framework was a decade old by the time LLMs adopted a version of it. The new signals overlap substantially with the old ones. Here's the rest, with the practical implications for SaaS and content sites.
Mar 12, 2026 · 3 min · Crawlmind Engineering
Why your llms.txt is probably broken (and how to tell)
Across the llms.txt files we parse in customer audits, most have at least one issue that materially reduces their usefulness to AI engines. Here are the seven most common, in order of frequency.
Feb 28, 2026 · 3 min · Crawlmind Engineering
The seven AI crawlers you should know about in 2026
A field guide to the seven crawlers that actually matter for AI search visibility right now. What each one does, the right robots-txt posture for most SaaS, and the common misconfigurations to avoid.
Feb 15, 2026 · 3 min · Crawlmind Engineering
The cost of being invisible to AI. A SaaS pricing case study.
A B2B SaaS noticed organic traffic was flat while pipeline was softer than usual. The cause was not Google. It was being absent from the AI answers their buyers were actually reading.
Feb 01, 2026 · 3 min · Crawlmind Engineering
dateModified. The most underrated SEO lever in 2026.
Most SaaS sites set dateModified once at publish time and never touch it again. The cost is real, the fix is cheap, and the trap of "fake date refresh" is worth understanding before you reach for it.
Jan 18, 2026 · 3 min · Crawlmind Engineering
Why SaaS teams need citation tracking, not rank
Rank tracking measures where Google puts you. Citation tracking measures whether ChatGPT, Perplexity and Gemini actually surface you when a buyer asks. The two metrics increasingly disagree, and only one of them predicts pipeline.
Jan 04, 2026 · 4 min · Crawlmind Engineering
Content strategy for the LLM era. Six principles that replace the old playbook.
The content playbook built for 2018 SEO doesn't survive contact with LLM answer engines. Six principles that replace the old assumptions, with the strategic and operational implications for content teams.
Dec 12, 2025 · 4 min · Crawlmind Engineering
FAQ pages still work in 2026 (if you build them right)
Google deprecated FAQ rich results in 2023. Many teams concluded FAQ markup was dead. The opposite turned out to be true for AI engines, but only if your FAQ is actually a FAQ. Here's the distinction that matters.
Nov 20, 2025 · 3 min · Crawlmind Engineering