GEO & AEO Playbook

Get your company named and cited in AI answers

Eight steps to measure where you stand in ChatGPT, Perplexity, Claude and Google’s AI features, let the right crawlers in, serve pages they can read, publish facts worth citing, get mentioned where buyers talk and measure the result honestly. One fictional company is worked through every step.

By Saroj Jha, founder of AAJ. 20 min read, 8 steps, 8 figures, 28 references.

GEO and AEO are the work of getting your company named, and linked, in the answers that ChatGPT, Perplexity, Claude and Google’s AI Overviews and AI Mode write. Most of it is search basics done thoroughly: let the right crawlers in, serve pages they can read, answer buyers’ questions with facts worth repeating, and get mentioned where buyers talk. Then measure it with repeated runs, because one answer tells you very little.

What you will build

  1. Steps 1 and 8 A baseline you can re-run 15 to 20 buyer questions, five runs on each engine
  2. Steps 2 and 3 Pages every engine can read Answer crawlers allowed, content in the HTML, pages indexed
  3. Steps 4 and 5 Answer-first pages Honest markup and a first sentence that answers
  4. Steps 6 and 7 Facts others repeat One data study, its cluster and mentions in the same words

Worked example: Example Co., a fictional seed-stage veterinary-software company, runs through every step. Pairs with the Crawl-to-Citation Scorer (free tool) and the AI Visibility Starter Kit (free template).

Buyers now ask these tools for shortlists. Google says AI Mode has passed 1 billion monthly users since it expanded worldwide[1]. And when Google shows an AI summary, people click less: in Pew Research Center’s browsing data from 900 US adults in March 2025, they clicked a standard result on 8% of searches that showed a summary against 15% of those that did not, and clicked a link inside the summary 1% of the time[2]. Being cited seems to soften the loss. Seer Interactive, an agency, found organic click-through of 0.70% for brands cited in an AI Overview against 0.52% for brands left out, a correlation it cautions may not be cause and effect[3].

The names overlap. SEO earns a place in ranked results. AEO, answer engine optimization, earns the direct answer, from a featured snippet to a voice reply. GEO, generative engine optimization, earns a citation in an answer a model writes. Google treats optimizing for its AI features as SEO, because they rest on its core ranking systems[4]. Ranking alone is not enough, though: in Ahrefs’ early-2026 study of 863,000 keywords, 38% of the pages cited in AI Overviews ranked in Google’s top 10 for the same query, though Ahrefs changed its method since an earlier run that found 76%[5].

This field is full of confident numbers with little behind them. I say where the evidence is thin, and I keep the steps to what you can check yourself. For a longer review of the research, see What Is GEO? What the Evidence Actually Says About AI Citations.

Step 1 of 8

Run your AI visibility baseline

Start by finding out what the engines say today, because every later step is judged against it. Write 15 to 20 questions a buyer would ask before they know your name: “best tool for…” questions, comparisons and alternatives, how-to problems your product solves, and what it costs. Leave your brand out. Asked by name, a model usually knows a company, which flatters you: in a January 2026 preprint, gpt-4o-mini recognized 99.4% of 112 Product Hunt startups by name but named them in only 3.32% of answers to questions about their category, and Perplexity in 8.29%[6]. Ask about yourself by name separately, to check what engines get wrong.

Then ask each question on the engines your buyers use, several times each, because answers vary from run to run. A University of St. Gallen team that tracked ChatGPT, Gemini, Google AI Mode and Perplexity daily in early 2026 found that the sources cited for the same prompts overlapped by only about a third to two-fifths from one day to the next, and that estimates steadied only at seven or eight runs per prompt per day[7]. A startup cannot run that much by hand. Five runs per question per engine, in one week, is my working minimum, and it is why you read the result as a range rather than a score.

For every answer, record whether your company is named, whether your site is linked as a source, and who else is named. Report each engine separately, and freeze the question list so later runs compare like with like. Set no target yet: I know of no honest benchmark for a first-month citation rate. The free AI Visibility Significance Test sizes the question set before you run it, and the AI Visibility Starter Kit has a prompt template and a run log.

Figure 1 Before any work, Example Co. was named in 9 of 400 answers, and never for a how-to or pricing question
Question group ChatGPT Perplexity Claude Google AI Mode
“Best tool for…” 6 questions, 30 answers per engine 1 of 30 3 of 30 0 of 30 1 of 30
Comparisons and alternatives 5 questions, 25 answers per engine 1 of 25 2 of 25 0 of 25 1 of 25
“How do I…” problems 6 questions, 30 answers per engine 0 of 30 0 of 30 0 of 30 0 of 30
“What does it cost?” 3 questions, 15 answers per engine 0 of 15 0 of 15 0 of 15 0 of 15
All 20 questions 100 answers per engine 2 of 100 5 of 100 0 of 100 2 of 100

9 answers of 400 named Example Co.; 3 linked to its site

188 answers of 400 named Rival A, its largest competitor

0 1 2 3 Darker cells: more answers naming Example Co.

Show the numbers as a table
Questions ChatGPT Perplexity Claude AI Mode
Best tool 1 of 30 3 of 30 0 of 30 1 of 30
Comparisons 1 of 25 2 of 25 0 of 25 1 of 25
How do I 0 of 30 0 of 30 0 of 30 0 of 30
Cost 0 of 15 0 of 15 0 of 15 0 of 15
All 20 2 of 100 5 of 100 0 of 100 2 of 100

Example Co.’s 20 buyer questions, none naming Example Co., each asked five times on each engine in one week. Example Co. and its numbers are fictional.

Step 2 of 8

Let the answer crawlers in

An engine can only quote a page it can fetch, and each AI company runs separate crawlers for separate jobs (Figure 2). Search crawlers build the index an assistant searches; user fetchers load a page when a person asks about it; training crawlers collect pages for future models. OpenAI says sites that block OAI-SearchBot are not shown in ChatGPT’s search answers, while blocking GPTBot only opts them out of training[8]. Anthropic splits its crawlers the same way into Claude-SearchBot, Claude-User and ClaudeBot[9], and Perplexity uses PerplexityBot for search and Perplexity-User for a person’s requests[10]. Google has no separate AI crawler: AI Overviews and AI Mode draw on pages Googlebot has indexed, and a page must be indexed and eligible to show with a snippet[4].

Training crawlers are a separate decision. Blocking GPTBot or ClaudeBot keeps your pages out of future training, not out of today’s answers. Let them in if you want future models to know your category; block them if your content is what you sell.

Then check the four places a block can hide. First robots.txt. Second, your CDN or firewall: Cloudflare, which says it handles traffic for about 20% of the web, has started new domains with AI crawlers blocked unless the owner allows them since July 1, 2025[11], and in July 2026 it announced new defaults from September 15, 2026 that allow search crawlers but block training and agent use on pages that carry ads[12]. Third, your server logs: a 403 response to a crawler’s user agent means something in front of your site turned it away. Fourth, Search Console, which now has a setting that removes a site from AI Overviews, AI Mode and Discover’s AI features; it is on by default, so check nobody has switched it off[13]. OpenAI and Perplexity say a robots.txt change takes up to about 24 hours to reach their systems.

Figure 2 Example Co.’s CDN turned away eight AI crawlers before they could read robots.txt; only Googlebot and Bingbot got through
  1. Search crawlers Build the index an assistant searches. Block one and you leave that engine’s answers.
  2. OAI-SearchBot OpenAI: ChatGPT search 403 at the CDN
  3. PerplexityBot Perplexity 403 at the CDN
  4. Claude-SearchBot Anthropic: Claude 403 at the CDN
  5. Googlebot Google: Search, AI Overviews and AI Mode Reaches the page
  6. Bingbot Microsoft: Bing and Copilot Reaches the page
  7. User fetchers Load one page when a person asks about it.
  8. ChatGPT-User OpenAI 403 at the CDN
  9. Perplexity-User Perplexity 403 at the CDN
  10. Claude-User Anthropic 403 at the CDN
  11. Training crawlers Collect pages for future models. Blocking them does not remove you from today’s answers.
  12. GPTBot OpenAI 403 at the CDN
  13. ClaudeBot Anthropic 403 at the CDN

Tokens, not crawlers. Google-Extended and Applebot-Extended are names you can use in robots.txt to opt out of AI training, and for Google-Extended of grounding answers in Gemini apps. Neither fetches pages, and neither affects Google’s or Apple’s search results.

Crawler roles from OpenAI[8], Anthropic[9], Perplexity[10], Google[14] and Apple[15], checked October 2026. Perplexity says Perplexity-User generally ignores robots.txt; OpenAI says robots.txt may not apply to ChatGPT-User. Example Co.’s blocks are fictional.

Step 3 of 8

Make every page readable without JavaScript, and indexed

Letting crawlers in is wasted if they find an empty page. Many crawlers read only the HTML your server sends and do not run JavaScript. In Vercel’s December 2024 analysis of traffic on its network, none of the major AI crawlers rendered JavaScript, OpenAI’s and Anthropic’s included, while Gemini, through Googlebot, and Applebot did[16]. That is a single analysis and nearly two years old, and I have found no public update, so test your own pages rather than rely on it.

A single-page app built in React, Vue or a similar framework without server-side rendering sends a near-empty shell and builds the page in the browser. The test takes a minute: fetch the page without a browser, with curl -s https://yourdomain.com/pricing, and look for your headline, prices and main answer in what comes back. If they are missing, render on the server or prerender to static HTML, starting with the pages buyers ask about: pricing, product, comparisons and the guides in Step 6. Keep facts out of tabs and accordions that load on click, and out of logged-in areas.

Then make sure the pages are in the indexes the engines search. Google’s AI features draw on its Search index, so submit a sitemap in Search Console and fix what its reports flag. Do the same in Bing Webmaster Tools: Bing’s index feeds Microsoft Copilot and Bing’s AI summaries, and since February 2026 its AI Performance report shows how often your pages are cited there[17]. Turn on IndexNow, which tells participating search engines, Bing among them, when a page is added, changed or removed. OpenAI does not say which outside search providers ChatGPT uses, so for ChatGPT the requirement you control is OAI-SearchBot’s access in Step 2. Keep pages fast as well: Google’s Core Web Vitals call a page good when it shows its main content within 2.5 seconds, responds to input within 200 milliseconds and shifts its layout by 0.1 or less, for three in four visits[18].

Figure 3 Fetched without a browser, Example Co.’s pricing page had 12 words; prerendered, it has 1,160

Before Rendered in the browser

<!doctype html> <title>Pricing | Example Co.</title> <script src="/assets/app.js"></script> <div id="root"></div> <noscript>You need to enable JavaScript to run this app.</noscript>

12 words a crawler can read

The plans and prices are built by JavaScript after the page loads, so a crawler that does not run it sees none of them.

After Prerendered to static HTML

<title>Pricing | Example Co.</title> <h1>Pricing for independent clinics</h1> <p>Every plan is billed per vet, per month…</p> <h2>Starter: $99 per vet</h2> <h2>Growth: $149 per vet</h2> … 1,160 words in all

1,160 words a crawler can read

The same request now returns every heading, plan and price as text.

Show the numbers as a table
Version Words a crawler can read
Rendered in the browser 12
Prerendered to static HTML 1,160

Source of Example Co.’s pricing page fetched with curl, abridged; highlighted text is what a crawler can read. Bars are drawn to scale. Example Co. and its numbers are fictional.

Step 4 of 8

Add structured data that matches the page, and decide on llms.txt last

Structured data helps engines read who you are and what you sell, but it is not a switch for AI answers. Google says structured data is not required for its generative AI features, that there is no special schema.org markup to add for them, and that it is still worth using as part of ordinary SEO[4]. So mark up what is on the page: Organization on the homepage, with your name, logo, address and sameAs links to your official profiles; Article with a named author on every article; and Product or SoftwareApplication with an Offer where you publish prices. Google’s rule is simple: do not mark up content that readers cannot see on the page[19]. Check each type with the Rich Results Test and the Schema Markup Validator.

Two types the old advice leans on no longer show anything in Google. How-to rich results were removed in September 2023, and FAQ rich results, by then limited to government and health sites, stopped appearing on May 7, 2026[20]. Keep a FAQ section wherever buyers have real questions, because people and engines read the text; the markup on its own earns nothing in Google.

llms.txt is a 2024 proposal by Jeremy Howard for a Markdown file at the root of a site that lists its key pages for language models[21]. It is not a standard, and no major AI search engine has said it reads one. Google says Google Search ignores these files, so making one neither helps nor harms you there. Almost nothing else reads them either: in Ahrefs’ May 2026 request logs, 97% of about 38,000 llms.txt files got no requests at all, and search crawlers from OpenAI, Perplexity and Anthropic made about 1% of the requests the rest received (Figure 4; Ahrefs, 2026[22]). The named AI tools that did fetch them were led by GPTBot and Claude Code, a coding agent, so the file is most useful for developer documentation. Otherwise it costs ten minutes and does no harm: decide, write the decision down and move on.

Figure 4 In May 2026, 97 of every 100 llms.txt files got no requests at all, and AI search crawlers made about 1% of the rest

Valid llms.txt files, May 2026

No requests: 97 At least one request: 3

Who requested the files that did get traffic Share of requests

SEO audit tools 21.7%
Named AI bots, all kinds 19.5%
Unidentified bots 14.9%
General web crawlers 13.1%
AI search crawlersOAI-SearchBot, PerplexityBot and Claude’s search crawler, part of the named AI bots 1.1%
Show the numbers as a table
Measure Value
Valid llms.txt files with no requests in May 2026 97%
Share of requests, SEO audit tools 21.7%
Share of requests, Named AI bots, all kinds 19.5%
Share of requests, Unidentified bots 14.9%
Share of requests, General web crawlers 13.1%
Share of requests, AI search crawlers 1.1%

Ahrefs, “We Analyzed 137K Sites: 97% of llms.txt Files Never Get Read”, June 15, 2026[22]: request logs for May 2026 from 137,210 domains in Ahrefs Web Analytics, about 38,000 of them with a valid llms.txt. Vendor study, not peer reviewed; the sample skews technical. Bars are drawn to scale.

Step 5 of 8

Answer the question in the first sentence

When an engine answers, it lifts a passage, not a page, so each section should stand on its own. The pattern I use: a heading phrased as the question a buyer asks, the direct answer in the first sentence, then the evidence (a number, a date, a named source with a link), then what to do. That is good practice for readers and for extraction. No study I trust has measured it as a lift on its own.

The research on rewriting content for AI is thinner than the advice built on it. The 2024 GEO paper from Princeton and IIT Delhi found that adding quotations gave a source about 41% more of a GPT-3.5 answer, and adding statistics about 31%, but only for pages already placed in the model’s context; it did not test whether rewriting helps a page get found[23]. A February 2026 preprint from Yonsei University rebuilt the whole pipeline over 171,003 documents and found that rewriting body text for citation made pages less visible at every stage, while rewriting only the title, meta description, headings and structured data helped them get retrieved (Figure 5; Kim and colleagues, 2026[24]). So put the effort into what a retrieval system reads first: a title and headings that match the question, a description that states the answer, and a first sentence that gives it.

Where a claim needs a number, give the number, its source and its year. A vague claim gives an engine nothing to quote, and an invented one is worse than none. Keyword stuffing does not help either: in the GEO paper it cut a source’s share of the answer by about 8%.

Figure 5 Across a full search pipeline, rewriting the body for AI lowered a page’s visibility; rewriting only its title, headings and markup raised retrieval

Body text rewritten for citation Only title, meta description, headings and structured data rewritten

Retrieved in the top 20

Body text: down 9% Title, headings and markup: up 22%

Kept in the top 10 after reranking

Body text: down 16% Title, headings and markup: down 17%

Cited in the final answer

Body text: down 6% Title, headings and markup: up 2%

Show the numbers as a table
Stage Body rewritten Structure rewritten
Retrieved in the top 20 Down 9% Up 22%
Kept in the top 10 after reranking Down 16% Down 17%
Cited in the final answer Down 6% Up 2%

Kim and colleagues (Yonsei University), “SAGEO Arena”, arXiv preprint, February 2026, Table 2: average change against the unedited page across rewriting strategies, 171,003 documents and 2,700 queries[24]. A single study, not yet peer reviewed.

Step 6 of 8

Build a cluster around one piece of original data

An engine has to cite someone for a fact, and the surest way to be that someone is to publish a fact nobody else has: data from your product, a survey of your customers, a benchmark with its method written down. No study ranks content formats by how often they are cited, so the order I use is judgment, not measurement: original data first, then the definitions and comparisons buyers ask for, then how-to guides. Opinion pieces seldom give an engine anything to cite.

Build the rest around it: one pillar page that answers the category question in full, and five to seven supporting pages (a how-to, a comparison, a pricing explainer, a checklist, common mistakes, a glossary), each linking to the pillar and to the data, and both linking back. A single page is easy to miss; a linked set on one topic gives engines several ways in. Put a named author on each page and refresh the data on a schedule. Microsoft’s advice for its own AI answers is that regular updates help AI systems cite the current version of your content[17].

Figure 6 Example Co.’s cluster: one data study only it could publish, one pillar page and six supporting pages, all linked to both
  1. Data study Missed appointments 2025: how 140 independent clinics book and remind 34% of missed appointments had no reminder sent
  2. Pillar page What is veterinary practice software?
  3. How-to How do I cut no-shows at a veterinary clinic?
  4. Comparison Clinic software vs paper books and spreadsheets
  5. Pricing What does veterinary practice software cost per vet?
  6. Checklist Choosing clinic software: a buyer’s checklist
  7. Mistakes Six billing mistakes that cost a clinic a day’s revenue
  8. Glossary Clinic billing terms, from estimates to wellness plans
  9. Every page links to the pillar and to the study, and both link back.

Example Co.’s plan from Step 6. The 34% is a median from its own product data across 140 client clinics and 1.9 million appointments in 2025. Example Co. and its numbers are fictional.

Step 7 of 8

Get mentioned where engines look, in the same words everywhere

Engines name companies that other sources name. Profound, a company that sells AI visibility tracking, counted about 680 million citations from August 2024 to June 2025: Wikipedia was ChatGPT’s most-cited source, Reddit led on Perplexity and on Google’s AI Overviews, and YouTube was close behind on both (Figure 7; Profound, 2025[25]). It is one vendor’s data for one period, and engines change what they cite, but the pattern is clear enough: answers lean on communities, reference sites and video, not only on company websites. The preprint in Step 1 points the same way: on Perplexity, the number of other sites linking to a startup was the strongest predictor of being named, and the paper’s content score predicted nothing[6].

So be present where your buyers already talk. Answer questions in the communities they use, as yourself and saying who you work for; most communities ban promotion, and a removed post helps nobody. Ask customers for reviews on the review sites in your category. Pitch guest articles and podcast appearances, and publish the transcripts on your own site. Grok can search posts on X as well as the web[26], so if your buyers are on X, post there too.

Then make it easy to tell that all those mentions are one company. Write one sentence that says what you do and for whom, and use it word for word on your site, in your Organization markup, on LinkedIn, on review and directory profiles and in your press kit, with the same company name, founder names and category words everywhere.

Figure 7 Each engine leaned on a different outside source: Wikipedia for ChatGPT, Reddit for Perplexity and AI Overviews

Share of all the engine’s citations, August 2024 to June 2025

ChatGPT

Wikipedia 7.8%
Reddit 1.8%
YouTube Not in its 10 most-cited sources

Google AI Overviews

Wikipedia 0.6%
Reddit 2.2%
YouTube 1.9%

Perplexity

Wikipedia Not in its 10 most-cited sources
Reddit 6.6%
YouTube 2.0%
Show the numbers as a table
Engine Wikipedia Reddit YouTube
ChatGPT 7.8% 1.8% Not in top 10
Google AI Overviews 0.6% 2.2% 1.9%
Perplexity Not in top 10 6.6% 2.0%

Profound, “AI Platform Citation Patterns”, June 2025, updated August 2025[25]: about 680 million citations. Vendor research, not peer reviewed; engines’ sources change over time. All bars share one scale.

Step 8 of 8

Re-run the baseline, read it honestly, then keep a monthly hour

Measure in three layers, because none is enough alone. First, the answers: re-run the frozen questions from Step 1 on the same engines with the same number of runs, and compare shares, not single answers. Second, the engines’ own reports: since August 31, 2026, Search Console’s generative AI performance report has shown how often links to your pages appear in AI Overviews and AI Mode, counting impressions, not clicks[27], and Bing’s AI Performance report counts citations in Copilot and Bing’s AI summaries. Third, your logs and analytics: crawler requests appear only in server or CDN logs, because crawlers do not run analytics tags, and visits from assistants appear in GA4, where ChatGPT adds utm_source=chatgpt.com to the links it sends[28]. Branded search is worth a glance too, but as context: I know of no study that ties it to AI citations.

Be honest about noise. Repeated runs of the same question are not independent, and engines change week to week, so a small rise can be chance. The AI Visibility Significance Test tells you whether a change is bigger than your sample could produce by chance. After the first 60 days (Figure 8), keep it running in an hour a month: re-run the questions, read the three layers, check the logs for new 403s, and choose one page to refresh and one to write.

Figure 8 Example Co.’s 60 days: access and rendering first, content in the middle, the re-run at the end, then one hour a month

Step 1 2 3 4 5 6 7 8 9 Then monthly

  1. Step 1 Baseline: 400 answers Week 1
  2. Step 2 Crawler access Week 1
  3. Step 3 Rendering and indexing Weeks 2 to 3
  4. Step 4 Structured data, llms.txt decision Week 3
  5. Step 5 Rewrite the top 10 pages Weeks 4 to 5
  6. Step 6 Data study and cluster Weeks 4 to 8 Refresh one page, write one
  7. Step 7 Description, reviews, communities Weeks 5 to 9 One answer a week
  8. Step 8 Re-run and read Week 9 One hour

Week 9 is days 57 to 60.

Example Co.’s plan for one marketer, part of a developer’s time for Steps 3 and 4, and the CEO for Step 7. Example Co. and its numbers are fictional.

What changes by stage?

Pre-seed

Check access and rendering on the few pages you have (Steps 2 and 3), make sure the homepage says plainly what you do and for whom, and ask ten buyer questions by hand once a quarter. Mentions from customers and communities (Step 7) will do more than anything you publish.

Seed

Run the full 60 days once, from a frozen question set to one data study and its cluster, then keep the monthly hour (Steps 1 to 8).

Series A–B

Give AI visibility one owner, track more questions and engines with a tool that shows its sample sizes, publish data on a schedule, and report Search Console and Bing citation data next to pipeline (Steps 6 and 8).

What mistakes should I avoid?

  • Blocking answer crawlers by accident. Check robots.txt, the CDN, the logs and Search Console (Step 2).
  • Letting crawlers in to an empty JavaScript shell. Fetch each key page without a browser (Step 3).
  • Treating llms.txt or FAQ markup as a lever. Neither moves Google; spend the time on access and content (Step 4).
  • Rewriting body copy to sound quotable. Fix titles, headings and first sentences, and add sourced facts (Step 5).
  • Reading one run as a result. Repeat each question and compare shares (Steps 1 and 8).
  • Describing your company differently everywhere. Use one sentence, word for word (Step 7).

Common questions

What are GEO and AEO, and how are they different from SEO?

SEO earns a place in a list of ranked results. AEO, answer engine optimization, earns the direct answer, such as a featured snippet or a voice reply. GEO, generative engine optimization, earns a mention or a citation in an answer an AI model writes, in ChatGPT, Perplexity, Claude or Google’s AI Overviews and AI Mode. They share most of the groundwork, crawlable and indexed pages that answer real questions, and Google says optimizing for its AI features is still SEO[4].

How long does GEO take to show results?

There is no published timeline you can rely on. Access fixes take effect quickly: OpenAI and Perplexity say robots.txt changes reach their systems within about 24 hours[8]. Being named more often depends on content and outside mentions, which take months, and answers vary from run to run, so judge progress over a window of two to four weeks of repeated runs rather than one check.

Which AI engines should I optimize for first?

The ones your buyers use, which you can find by asking customers how they researched you. For most companies that starts with Google, whose AI Mode passed 1 billion monthly users in 2026[1], and ChatGPT, which needs OAI-SearchBot let in. The groundwork is shared, so one set of fixes serves Perplexity, Claude and Copilot too; only crawler access and measurement differ by engine.

Does llms.txt help me get cited by AI?

Not in any way anyone has shown. It is a 2024 proposal, not a standard, and no major AI search engine has said it reads the file; Google says Google Search ignores it. In Ahrefs’ May 2026 logs, 97% of about 38,000 llms.txt files got no requests at all[22]. It is cheap and harmless, and most useful for developer documentation that coding agents read.

Should I block AI training crawlers like GPTBot?

That is a business decision, separate from being cited. Blocking GPTBot or ClaudeBot keeps your pages out of future model training, but OpenAI and Anthropic use other crawlers, OAI-SearchBot and Claude-SearchBot, for search answers. Google-Extended and Applebot-Extended are opt-out tokens that do not affect Google’s or Apple’s search results[15]. Block training if your content is what you sell; allow it if you want future models to know your category.

Are paid AI visibility tracking tools worth it?

They save time once you track more questions and engines than you can run by hand, but they sample answers the same way you would. Ask each vendor how many runs per question it makes and how it treats answers where the engine did not search, because a single run is a weak reading. Google warns that no third-party tool has access to its ranking or AI systems[4].

Use with this playbook

Playbooks

Articles

Templates and tools

References

  1. Pichai, S. (2026). Q2 2026 earnings call: Remarks from our CEO. Google, July 22, 2026. blog.google
  2. Pew Research Center (2025). “Google users are less likely to click on links when an AI summary appears in the results.” Short read, July 22, 2025; browsing data from 900 US adults, March 2025. pewresearch.org
  3. McDonald, T. (2025). “AIO Impact on Google CTR: September 2025 Update.” Seer Interactive, November 4, 2025. Agency study, not peer reviewed: 3,119 queries across 42 client organizations, June 2024 to September 2025. seerinteractive.com
  4. Google Search Central (2026). “Google’s Guide to Optimizing for Generative AI Features on Google Search.” Added May 15, 2026; last updated July 10, 2026. developers.google.com
  5. Linehan, L. (2026). Ahrefs’ updated study of how many pages cited in Google AI Overviews rank in the top 10: an analysis of 863,000 keywords and about 4 million AI Overview URLs, early 2026; vendor study, method changed since its July 2025 run. ahrefs.com
  6. Sharma, A. P. (2026). “The Discovery Gap: How Product Hunt Startups Vanish in LLM Organic Discovery Queries.” arXiv preprint 2601.00912. Not peer reviewed: 112 startups, 2,240 queries to gpt-4o-mini and Perplexity Sonar, December 2025. arxiv.org
  7. Schulte, J., Bleeker, M. and Kaufmann, P. (2026). “Don’t Measure Once: Measuring Visibility in AI Search (GEO).” arXiv preprint 2604.07585, April 2026. Not peer reviewed: ChatGPT, Gemini, Google AI Mode and Perplexity, January 24 to March 20, 2026. arxiv.org
  8. OpenAI (2026). Overview of OpenAI Crawlers: OAI-SearchBot, GPTBot, ChatGPT-User and OAI-AdsBot. developers.openai.com
  9. Anthropic (2026). “Does Anthropic crawl data from the web, and how can site owners block the crawler?” ClaudeBot, Claude-User and Claude-SearchBot. support.claude.com
  10. Perplexity (2026). Perplexity Crawlers: PerplexityBot and Perplexity-User. docs.perplexity.ai
  11. Cloudflare (2025). “Cloudflare Just Changed How AI Crawlers Scrape the Internet-at-Large.” Press release, July 1, 2025. cloudflare.com
  12. Cloudflare (2026). “Cloudflare Allows the Agentic Internet to Flourish with a Simple Philosophy: Your Content, Your Rules.” Press release, July 1, 2026. cloudflare.com
  13. Google Search Console Help (2026). Search generative AI control. Rolled out to all websites by August 31, 2026. support.google.com
  14. Google (2026). List of Google’s common crawlers, including the Google-Extended product token. Last updated October 15, 2026. developers.google.com
  15. Apple (2026). About Applebot, including Applebot-Extended. Published September 4, 2026. support.apple.com
  16. Zecchini, G., Moore, A. A., Ubl, M. and Siddle, R. (2024). “The rise of the AI crawler.” Vercel, December 17, 2024. vercel.com
  17. Madhavan, K., Merchant, M., Canel, F. and Nigam, S. (2026). “Introducing AI Performance in Bing Webmaster Tools Public Preview.” Microsoft Bing Webmaster Blog, February 2026. blogs.bing.com
  18. web.dev (2026). Web Vitals: thresholds for Largest Contentful Paint, Interaction to Next Paint and Cumulative Layout Shift. web.dev
  19. Google Search Central (2026). General structured data guidelines. Last updated July 10, 2026. developers.google.com
  20. Google Search Central (2023–2026). Search Central documentation updates: How-to rich results removed (September 2023); FAQ rich results limited to government and health sites (September 2023) and no longer shown from May 7, 2026. developers.google.com
  21. Howard, J. (2024). “The /llms.txt file.” Proposal, September 3, 2024. llmstxt.org
  22. Linehan, L. (2026). “We Analyzed 137K Sites: 97% of llms.txt Files Never Get Read.” Ahrefs, June 15, 2026. Vendor study: request logs for May 2026 from 137,210 domains. ahrefs.com
  23. Aggarwal, P., Murahari, V., Rajpurohit, T., Kalyan, A., Narasimhan, K. and Deshpande, A. (2024). “GEO: Generative Engine Optimization.” Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 2024). doi:10.1145/3637528.3671900
  24. Kim, S., Jeong, W., Kim, S., Lee, S. and Lee, D. (2026). “SAGEO Arena: A Realistic Environment for Evaluating Search-Augmented Generative Engine Optimization.” arXiv preprint 2602.12187, February 12, 2026. Not peer reviewed. arxiv.org
  25. Lafferty, N. (2025). “AI Platform Citation Patterns: How ChatGPT, Google AI Overviews, and Perplexity Source Information.” Profound, June 5, 2025, updated August 2025. Vendor research: about 680 million citations, August 2024 to June 2025. tryprofound.com
  26. xAI (2026). Tools overview: Web Search and X Search. docs.x.ai
  27. Google Search Console Help (2026). Generative AI performance report (Search). Rolled out to all websites by August 31, 2026. support.google.com
  28. OpenAI Help Center (2026). Publishers and Developers FAQ: ChatGPT search, OAI-SearchBot and utm_source=chatgpt.com. help.openai.com

Fix access first, then earn the citations

Want a second pair of eyes on your crawler settings, rendering and question set before you start? AAJ can review them against your own site.

Or start on your own with the free AI Visibility Starter Kit.

More in AI Search & Agent Readiness

Part of the AI Search & Agent Readiness hub - see all 19 resources on this topic.

Also useful in Content, Copy & SEO.