GEO & AEO Playbook
Get your company named and cited in AI answers
Eight steps to measure where you stand in ChatGPT, Perplexity, Claude and Google’s AI features, let the right crawlers in, serve pages they can read, publish facts worth citing, get mentioned where buyers talk and measure the result honestly. One fictional company is worked through every step.
By Saroj Jha, founder of AAJ. 20 min read, 8 steps, 8 figures, 28 references.
GEO and AEO are the work of getting your company named, and linked, in the answers that ChatGPT, Perplexity, Claude and Google’s AI Overviews and AI Mode write. Most of it is search basics done thoroughly: let the right crawlers in, serve pages they can read, answer buyers’ questions with facts worth repeating, and get mentioned where buyers talk. Then measure it with repeated runs, because one answer tells you very little.
What you will build
- Steps 1 and 8 A baseline you can re-run 15 to 20 buyer questions, five runs on each engine
- Steps 2 and 3 Pages every engine can read Answer crawlers allowed, content in the HTML, pages indexed
- Steps 4 and 5 Answer-first pages Honest markup and a first sentence that answers
- Steps 6 and 7 Facts others repeat One data study, its cluster and mentions in the same words
Worked example: Example Co., a fictional seed-stage veterinary-software company, runs through every step. Pairs with the Crawl-to-Citation Scorer (free tool) and the AI Visibility Starter Kit (free template).
Buyers now ask these tools for shortlists. Google says AI Mode has passed 1 billion monthly users since it expanded worldwide[1]. And when Google shows an AI summary, people click less: in Pew Research Center’s browsing data from 900 US adults in March 2025, they clicked a standard result on 8% of searches that showed a summary against 15% of those that did not, and clicked a link inside the summary 1% of the time[2]. Being cited seems to soften the loss. Seer Interactive, an agency, found organic click-through of 0.70% for brands cited in an AI Overview against 0.52% for brands left out, a correlation it cautions may not be cause and effect[3].
The names overlap. SEO earns a place in ranked results. AEO, answer engine optimization, earns the direct answer, from a featured snippet to a voice reply. GEO, generative engine optimization, earns a citation in an answer a model writes. Google treats optimizing for its AI features as SEO, because they rest on its core ranking systems[4]. Ranking alone is not enough, though: in Ahrefs’ early-2026 study of 863,000 keywords, 38% of the pages cited in AI Overviews ranked in Google’s top 10 for the same query, though Ahrefs changed its method since an earlier run that found 76%[5].
This field is full of confident numbers with little behind them. I say where the evidence is thin, and I keep the steps to what you can check yourself. For a longer review of the research, see What Is GEO? What the Evidence Actually Says About AI Citations.
Step 1 of 8
Run your AI visibility baseline
Start by finding out what the engines say today, because every later step is judged against it. Write 15 to 20 questions a buyer would ask before they know your name: “best tool for…” questions, comparisons and alternatives, how-to problems your product solves, and what it costs. Leave your brand out. Asked by name, a model usually knows a company, which flatters you: in a January 2026 preprint, gpt-4o-mini recognized 99.4% of 112 Product Hunt startups by name but named them in only 3.32% of answers to questions about their category, and Perplexity in 8.29%[6]. Ask about yourself by name separately, to check what engines get wrong.
Then ask each question on the engines your buyers use, several times each, because answers vary from run to run. A University of St. Gallen team that tracked ChatGPT, Gemini, Google AI Mode and Perplexity daily in early 2026 found that the sources cited for the same prompts overlapped by only about a third to two-fifths from one day to the next, and that estimates steadied only at seven or eight runs per prompt per day[7]. A startup cannot run that much by hand. Five runs per question per engine, in one week, is my working minimum, and it is why you read the result as a range rather than a score.
For every answer, record whether your company is named, whether your site is linked as a source, and who else is named. Report each engine separately, and freeze the question list so later runs compare like with like. Set no target yet: I know of no honest benchmark for a first-month citation rate. The free AI Visibility Significance Test sizes the question set before you run it, and the AI Visibility Starter Kit has a prompt template and a run log.
9 answers of 400 named Example Co.; 3 linked to its site
188 answers of 400 named Rival A, its largest competitor
0 1 2 3 Darker cells: more answers naming Example Co.
Show the numbers as a table
| Questions | ChatGPT | Perplexity | Claude | AI Mode |
|---|---|---|---|---|
| Best tool | 1 of 30 | 3 of 30 | 0 of 30 | 1 of 30 |
| Comparisons | 1 of 25 | 2 of 25 | 0 of 25 | 1 of 25 |
| How do I | 0 of 30 | 0 of 30 | 0 of 30 | 0 of 30 |
| Cost | 0 of 15 | 0 of 15 | 0 of 15 | 0 of 15 |
| All 20 | 2 of 100 | 5 of 100 | 0 of 100 | 2 of 100 |
Example Co.’s 20 buyer questions, none naming Example Co., each asked five times on each engine in one week. Example Co. and its numbers are fictional.
Step 2 of 8
Let the answer crawlers in
An engine can only quote a page it can fetch, and each AI company runs separate crawlers for separate jobs (Figure 2). Search crawlers build the index an assistant searches; user fetchers load a page when a person asks about it; training crawlers collect pages for future models. OpenAI says sites that block OAI-SearchBot are not shown in ChatGPT’s search answers, while blocking GPTBot only opts them out of training[8]. Anthropic splits its crawlers the same way into Claude-SearchBot, Claude-User and ClaudeBot[9], and Perplexity uses PerplexityBot for search and Perplexity-User for a person’s requests[10]. Google has no separate AI crawler: AI Overviews and AI Mode draw on pages Googlebot has indexed, and a page must be indexed and eligible to show with a snippet[4].
Training crawlers are a separate decision. Blocking GPTBot or ClaudeBot keeps your pages out of future training, not out of today’s answers. Let them in if you want future models to know your category; block them if your content is what you sell.
Then check the four places a block can hide. First robots.txt. Second, your CDN or firewall: Cloudflare, which says it handles traffic for about 20% of the web, has started new domains with AI crawlers blocked unless the owner allows them since July 1, 2025[11], and in July 2026 it announced new defaults from September 15, 2026 that allow search crawlers but block training and agent use on pages that carry ads[12]. Third, your server logs: a 403 response to a crawler’s user agent means something in front of your site turned it away. Fourth, Search Console, which now has a setting that removes a site from AI Overviews, AI Mode and Discover’s AI features; it is on by default, so check nobody has switched it off[13]. OpenAI and Perplexity say a robots.txt change takes up to about 24 hours to reach their systems.
- Search crawlers Build the index an assistant searches. Block one and you leave that engine’s answers.
- OAI-SearchBot OpenAI: ChatGPT search 403 at the CDN
- PerplexityBot Perplexity 403 at the CDN
- Claude-SearchBot Anthropic: Claude 403 at the CDN
- Googlebot Google: Search, AI Overviews and AI Mode Reaches the page
- Bingbot Microsoft: Bing and Copilot Reaches the page
- User fetchers Load one page when a person asks about it.
- ChatGPT-User OpenAI 403 at the CDN
- Perplexity-User Perplexity 403 at the CDN
- Claude-User Anthropic 403 at the CDN
- Training crawlers Collect pages for future models. Blocking them does not remove you from today’s answers.
- GPTBot OpenAI 403 at the CDN
- ClaudeBot Anthropic 403 at the CDN
Tokens, not crawlers. Google-Extended and Applebot-Extended are names you can use in robots.txt to opt out of AI training, and for Google-Extended of grounding answers in Gemini apps. Neither fetches pages, and neither affects Google’s or Apple’s search results.
Crawler roles from OpenAI[8], Anthropic[9], Perplexity[10], Google[14] and Apple[15], checked October 2026. Perplexity says Perplexity-User generally ignores robots.txt; OpenAI says robots.txt may not apply to ChatGPT-User. Example Co.’s blocks are fictional.
Step 3 of 8
Make every page readable without JavaScript, and indexed
Letting crawlers in is wasted if they find an empty page. Many crawlers read only the HTML your server sends and do not run JavaScript. In Vercel’s December 2024 analysis of traffic on its network, none of the major AI crawlers rendered JavaScript, OpenAI’s and Anthropic’s included, while Gemini, through Googlebot, and Applebot did[16]. That is a single analysis and nearly two years old, and I have found no public update, so test your own pages rather than rely on it.
A single-page app built in React, Vue or a similar framework without server-side rendering sends a near-empty shell and builds the page in the browser. The test takes a minute: fetch the page without a browser, with curl -s https://yourdomain.com/pricing, and look for your headline, prices and main answer in what comes back. If they are missing, render on the server or prerender to static HTML, starting with the pages buyers ask about: pricing, product, comparisons and the guides in Step 6. Keep facts out of tabs and accordions that load on click, and out of logged-in areas.
Then make sure the pages are in the indexes the engines search. Google’s AI features draw on its Search index, so submit a sitemap in Search Console and fix what its reports flag. Do the same in Bing Webmaster Tools: Bing’s index feeds Microsoft Copilot and Bing’s AI summaries, and since February 2026 its AI Performance report shows how often your pages are cited there[17]. Turn on IndexNow, which tells participating search engines, Bing among them, when a page is added, changed or removed. OpenAI does not say which outside search providers ChatGPT uses, so for ChatGPT the requirement you control is OAI-SearchBot’s access in Step 2. Keep pages fast as well: Google’s Core Web Vitals call a page good when it shows its main content within 2.5 seconds, responds to input within 200 milliseconds and shifts its layout by 0.1 or less, for three in four visits[18].
Before Rendered in the browser
12 words a crawler can read
The plans and prices are built by JavaScript after the page loads, so a crawler that does not run it sees none of them.
After Prerendered to static HTML
1,160 words a crawler can read
The same request now returns every heading, plan and price as text.
Show the numbers as a table
| Version | Words a crawler can read |
|---|---|
| Rendered in the browser | 12 |
| Prerendered to static HTML | 1,160 |
Source of Example Co.’s pricing page fetched with curl, abridged; highlighted text is what a crawler can read. Bars are drawn to scale. Example Co. and its numbers are fictional.
Step 4 of 8
Add structured data that matches the page, and decide on llms.txt last
Structured data helps engines read who you are and what you sell, but it is not a switch for AI answers. Google says structured data is not required for its generative AI features, that there is no special schema.org markup to add for them, and that it is still worth using as part of ordinary SEO[4]. So mark up what is on the page: Organization on the homepage, with your name, logo, address and sameAs links to your official profiles; Article with a named author on every article; and Product or SoftwareApplication with an Offer where you publish prices. Google’s rule is simple: do not mark up content that readers cannot see on the page[19]. Check each type with the Rich Results Test and the Schema Markup Validator.
Two types the old advice leans on no longer show anything in Google. How-to rich results were removed in September 2023, and FAQ rich results, by then limited to government and health sites, stopped appearing on May 7, 2026[20]. Keep a FAQ section wherever buyers have real questions, because people and engines read the text; the markup on its own earns nothing in Google.
llms.txt is a 2024 proposal by Jeremy Howard for a Markdown file at the root of a site that lists its key pages for language models[21]. It is not a standard, and no major AI search engine has said it reads one. Google says Google Search ignores these files, so making one neither helps nor harms you there. Almost nothing else reads them either: in Ahrefs’ May 2026 request logs, 97% of about 38,000 llms.txt files got no requests at all, and search crawlers from OpenAI, Perplexity and Anthropic made about 1% of the requests the rest received (Figure 4; Ahrefs, 2026[22]). The named AI tools that did fetch them were led by GPTBot and Claude Code, a coding agent, so the file is most useful for developer documentation. Otherwise it costs ten minutes and does no harm: decide, write the decision down and move on.
Valid llms.txt files, May 2026
No requests: 97 At least one request: 3
Who requested the files that did get traffic Share of requests
Show the numbers as a table
| Measure | Value |
|---|---|
| Valid llms.txt files with no requests in May 2026 | 97% |
| Share of requests, SEO audit tools | 21.7% |
| Share of requests, Named AI bots, all kinds | 19.5% |
| Share of requests, Unidentified bots | 14.9% |
| Share of requests, General web crawlers | 13.1% |
| Share of requests, AI search crawlers | 1.1% |
Ahrefs, “We Analyzed 137K Sites: 97% of llms.txt Files Never Get Read”, June 15, 2026[22]: request logs for May 2026 from 137,210 domains in Ahrefs Web Analytics, about 38,000 of them with a valid llms.txt. Vendor study, not peer reviewed; the sample skews technical. Bars are drawn to scale.
Step 5 of 8
Answer the question in the first sentence
When an engine answers, it lifts a passage, not a page, so each section should stand on its own. The pattern I use: a heading phrased as the question a buyer asks, the direct answer in the first sentence, then the evidence (a number, a date, a named source with a link), then what to do. That is good practice for readers and for extraction. No study I trust has measured it as a lift on its own.
The research on rewriting content for AI is thinner than the advice built on it. The 2024 GEO paper from Princeton and IIT Delhi found that adding quotations gave a source about 41% more of a GPT-3.5 answer, and adding statistics about 31%, but only for pages already placed in the model’s context; it did not test whether rewriting helps a page get found[23]. A February 2026 preprint from Yonsei University rebuilt the whole pipeline over 171,003 documents and found that rewriting body text for citation made pages less visible at every stage, while rewriting only the title, meta description, headings and structured data helped them get retrieved (Figure 5; Kim and colleagues, 2026[24]). So put the effort into what a retrieval system reads first: a title and headings that match the question, a description that states the answer, and a first sentence that gives it.
Where a claim needs a number, give the number, its source and its year. A vague claim gives an engine nothing to quote, and an invented one is worse than none. Keyword stuffing does not help either: in the GEO paper it cut a source’s share of the answer by about 8%.
Body text rewritten for citation Only title, meta description, headings and structured data rewritten
Retrieved in the top 20
Body text: down 9% Title, headings and markup: up 22%
Kept in the top 10 after reranking
Body text: down 16% Title, headings and markup: down 17%
Cited in the final answer
Body text: down 6% Title, headings and markup: up 2%
Show the numbers as a table
| Stage | Body rewritten | Structure rewritten |
|---|---|---|
| Retrieved in the top 20 | Down 9% | Up 22% |
| Kept in the top 10 after reranking | Down 16% | Down 17% |
| Cited in the final answer | Down 6% | Up 2% |
Kim and colleagues (Yonsei University), “SAGEO Arena”, arXiv preprint, February 2026, Table 2: average change against the unedited page across rewriting strategies, 171,003 documents and 2,700 queries[24]. A single study, not yet peer reviewed.
Step 6 of 8
Build a cluster around one piece of original data
An engine has to cite someone for a fact, and the surest way to be that someone is to publish a fact nobody else has: data from your product, a survey of your customers, a benchmark with its method written down. No study ranks content formats by how often they are cited, so the order I use is judgment, not measurement: original data first, then the definitions and comparisons buyers ask for, then how-to guides. Opinion pieces seldom give an engine anything to cite.
Build the rest around it: one pillar page that answers the category question in full, and five to seven supporting pages (a how-to, a comparison, a pricing explainer, a checklist, common mistakes, a glossary), each linking to the pillar and to the data, and both linking back. A single page is easy to miss; a linked set on one topic gives engines several ways in. Put a named author on each page and refresh the data on a schedule. Microsoft’s advice for its own AI answers is that regular updates help AI systems cite the current version of your content[17].
- Data study Missed appointments 2025: how 140 independent clinics book and remind 34% of missed appointments had no reminder sent
- Pillar page What is veterinary practice software?
- How-to How do I cut no-shows at a veterinary clinic?
- Comparison Clinic software vs paper books and spreadsheets
- Pricing What does veterinary practice software cost per vet?
- Checklist Choosing clinic software: a buyer’s checklist
- Mistakes Six billing mistakes that cost a clinic a day’s revenue
- Glossary Clinic billing terms, from estimates to wellness plans
- Every page links to the pillar and to the study, and both link back.
Example Co.’s plan from Step 6. The 34% is a median from its own product data across 140 client clinics and 1.9 million appointments in 2025. Example Co. and its numbers are fictional.
Step 7 of 8
Get mentioned where engines look, in the same words everywhere
Engines name companies that other sources name. Profound, a company that sells AI visibility tracking, counted about 680 million citations from August 2024 to June 2025: Wikipedia was ChatGPT’s most-cited source, Reddit led on Perplexity and on Google’s AI Overviews, and YouTube was close behind on both (Figure 7; Profound, 2025[25]). It is one vendor’s data for one period, and engines change what they cite, but the pattern is clear enough: answers lean on communities, reference sites and video, not only on company websites. The preprint in Step 1 points the same way: on Perplexity, the number of other sites linking to a startup was the strongest predictor of being named, and the paper’s content score predicted nothing[6].
So be present where your buyers already talk. Answer questions in the communities they use, as yourself and saying who you work for; most communities ban promotion, and a removed post helps nobody. Ask customers for reviews on the review sites in your category. Pitch guest articles and podcast appearances, and publish the transcripts on your own site. Grok can search posts on X as well as the web[26], so if your buyers are on X, post there too.
Then make it easy to tell that all those mentions are one company. Write one sentence that says what you do and for whom, and use it word for word on your site, in your Organization markup, on LinkedIn, on review and directory profiles and in your press kit, with the same company name, founder names and category words everywhere.
Share of all the engine’s citations, August 2024 to June 2025
ChatGPT
Google AI Overviews
Perplexity
Show the numbers as a table
| Engine | Wikipedia | YouTube | |
|---|---|---|---|
| ChatGPT | 7.8% | 1.8% | Not in top 10 |
| Google AI Overviews | 0.6% | 2.2% | 1.9% |
| Perplexity | Not in top 10 | 6.6% | 2.0% |
Profound, “AI Platform Citation Patterns”, June 2025, updated August 2025[25]: about 680 million citations. Vendor research, not peer reviewed; engines’ sources change over time. All bars share one scale.
Step 8 of 8
Re-run the baseline, read it honestly, then keep a monthly hour
Measure in three layers, because none is enough alone. First, the answers: re-run the frozen questions from Step 1 on the same engines with the same number of runs, and compare shares, not single answers. Second, the engines’ own reports: since August 31, 2026, Search Console’s generative AI performance report has shown how often links to your pages appear in AI Overviews and AI Mode, counting impressions, not clicks[27], and Bing’s AI Performance report counts citations in Copilot and Bing’s AI summaries. Third, your logs and analytics: crawler requests appear only in server or CDN logs, because crawlers do not run analytics tags, and visits from assistants appear in GA4, where ChatGPT adds utm_source=chatgpt.com to the links it sends[28]. Branded search is worth a glance too, but as context: I know of no study that ties it to AI citations.
Be honest about noise. Repeated runs of the same question are not independent, and engines change week to week, so a small rise can be chance. The AI Visibility Significance Test tells you whether a change is bigger than your sample could produce by chance. After the first 60 days (Figure 8), keep it running in an hour a month: re-run the questions, read the three layers, check the logs for new 403s, and choose one page to refresh and one to write.
Step 1 2 3 4 5 6 7 8 9 Then monthly
- Step 1 Baseline: 400 answers Week 1
- Step 2 Crawler access Week 1
- Step 3 Rendering and indexing Weeks 2 to 3
- Step 4 Structured data, llms.txt decision Week 3
- Step 5 Rewrite the top 10 pages Weeks 4 to 5
- Step 6 Data study and cluster Weeks 4 to 8 Refresh one page, write one
- Step 7 Description, reviews, communities Weeks 5 to 9 One answer a week
- Step 8 Re-run and read Week 9 One hour
Week 9 is days 57 to 60.
Example Co.’s plan for one marketer, part of a developer’s time for Steps 3 and 4, and the CEO for Step 7. Example Co. and its numbers are fictional.
What changes by stage?
Pre-seed
Check access and rendering on the few pages you have (Steps 2 and 3), make sure the homepage says plainly what you do and for whom, and ask ten buyer questions by hand once a quarter. Mentions from customers and communities (Step 7) will do more than anything you publish.
Seed
Run the full 60 days once, from a frozen question set to one data study and its cluster, then keep the monthly hour (Steps 1 to 8).
Series A–B
Give AI visibility one owner, track more questions and engines with a tool that shows its sample sizes, publish data on a schedule, and report Search Console and Bing citation data next to pipeline (Steps 6 and 8).
What mistakes should I avoid?
- Blocking answer crawlers by accident. Check robots.txt, the CDN, the logs and Search Console (Step 2).
- Letting crawlers in to an empty JavaScript shell. Fetch each key page without a browser (Step 3).
- Treating llms.txt or FAQ markup as a lever. Neither moves Google; spend the time on access and content (Step 4).
- Rewriting body copy to sound quotable. Fix titles, headings and first sentences, and add sourced facts (Step 5).
- Reading one run as a result. Repeat each question and compare shares (Steps 1 and 8).
- Describing your company differently everywhere. Use one sentence, word for word (Step 7).
Common questions
What are GEO and AEO, and how are they different from SEO?
SEO earns a place in a list of ranked results. AEO, answer engine optimization, earns the direct answer, such as a featured snippet or a voice reply. GEO, generative engine optimization, earns a mention or a citation in an answer an AI model writes, in ChatGPT, Perplexity, Claude or Google’s AI Overviews and AI Mode. They share most of the groundwork, crawlable and indexed pages that answer real questions, and Google says optimizing for its AI features is still SEO[4].
How long does GEO take to show results?
There is no published timeline you can rely on. Access fixes take effect quickly: OpenAI and Perplexity say robots.txt changes reach their systems within about 24 hours[8]. Being named more often depends on content and outside mentions, which take months, and answers vary from run to run, so judge progress over a window of two to four weeks of repeated runs rather than one check.
Which AI engines should I optimize for first?
The ones your buyers use, which you can find by asking customers how they researched you. For most companies that starts with Google, whose AI Mode passed 1 billion monthly users in 2026[1], and ChatGPT, which needs OAI-SearchBot let in. The groundwork is shared, so one set of fixes serves Perplexity, Claude and Copilot too; only crawler access and measurement differ by engine.
Does llms.txt help me get cited by AI?
Not in any way anyone has shown. It is a 2024 proposal, not a standard, and no major AI search engine has said it reads the file; Google says Google Search ignores it. In Ahrefs’ May 2026 logs, 97% of about 38,000 llms.txt files got no requests at all[22]. It is cheap and harmless, and most useful for developer documentation that coding agents read.
Should I block AI training crawlers like GPTBot?
That is a business decision, separate from being cited. Blocking GPTBot or ClaudeBot keeps your pages out of future model training, but OpenAI and Anthropic use other crawlers, OAI-SearchBot and Claude-SearchBot, for search answers. Google-Extended and Applebot-Extended are opt-out tokens that do not affect Google’s or Apple’s search results[15]. Block training if your content is what you sell; allow it if you want future models to know your category.
Are paid AI visibility tracking tools worth it?
They save time once you track more questions and engines than you can run by hand, but they sample answers the same way you would. Ask each vendor how many runs per question it makes and how it treats answers where the engine did not search, because a single run is a weak reading. Google warns that no third-party tool has access to its ranking or AI systems[4].
Use with this playbook
Playbooks
- Content Creation Playbook: Plan and write the pages that answer buyers’ questions.
- Earned Media Playbook: Earn the articles and interviews engines draw on.
- Community & Dark Social Playbook: Show up in the communities where buyers ask for recommendations.
- Analytics & Attribution Playbook: Fit AI referrals into the rest of your measurement.
Articles
- What Is GEO? What the Evidence Actually Says About AI Citations: The research behind Steps 1 and 5, study by study.
- Why doesn't ChatGPT recommend my company?: The facts an engine needs before it will name you.
- Zero-Click Marketing for Startups: Win Without Clicks: Plan for answers that never send a visit.
- SEO for Startups: When to Start and What to Do First: The search groundwork Steps 2 and 3 rest on.
Templates and tools
- Crawl-to-Citation Scorer: Score a page on crawling, rendering, markup and citability.
- AI Visibility Significance Test: Size the question set and test whether a change is real.
- AI Visibility Starter Kit: An audit script, a prompt set, a run log and markup templates.
- Content Brief Builder: Spec an answer-first page before anyone writes it.
References
- Pichai, S. (2026). Q2 2026 earnings call: Remarks from our CEO. Google, July 22, 2026. blog.google
- Pew Research Center (2025). “Google users are less likely to click on links when an AI summary appears in the results.” Short read, July 22, 2025; browsing data from 900 US adults, March 2025. pewresearch.org
- McDonald, T. (2025). “AIO Impact on Google CTR: September 2025 Update.” Seer Interactive, November 4, 2025. Agency study, not peer reviewed: 3,119 queries across 42 client organizations, June 2024 to September 2025. seerinteractive.com
- Google Search Central (2026). “Google’s Guide to Optimizing for Generative AI Features on Google Search.” Added May 15, 2026; last updated July 10, 2026. developers.google.com
- Linehan, L. (2026). Ahrefs’ updated study of how many pages cited in Google AI Overviews rank in the top 10: an analysis of 863,000 keywords and about 4 million AI Overview URLs, early 2026; vendor study, method changed since its July 2025 run. ahrefs.com
- Sharma, A. P. (2026). “The Discovery Gap: How Product Hunt Startups Vanish in LLM Organic Discovery Queries.” arXiv preprint 2601.00912. Not peer reviewed: 112 startups, 2,240 queries to gpt-4o-mini and Perplexity Sonar, December 2025. arxiv.org
- Schulte, J., Bleeker, M. and Kaufmann, P. (2026). “Don’t Measure Once: Measuring Visibility in AI Search (GEO).” arXiv preprint 2604.07585, April 2026. Not peer reviewed: ChatGPT, Gemini, Google AI Mode and Perplexity, January 24 to March 20, 2026. arxiv.org
- OpenAI (2026). Overview of OpenAI Crawlers: OAI-SearchBot, GPTBot, ChatGPT-User and OAI-AdsBot. developers.openai.com
- Anthropic (2026). “Does Anthropic crawl data from the web, and how can site owners block the crawler?” ClaudeBot, Claude-User and Claude-SearchBot. support.claude.com
- Perplexity (2026). Perplexity Crawlers: PerplexityBot and Perplexity-User. docs.perplexity.ai
- Cloudflare (2025). “Cloudflare Just Changed How AI Crawlers Scrape the Internet-at-Large.” Press release, July 1, 2025. cloudflare.com
- Cloudflare (2026). “Cloudflare Allows the Agentic Internet to Flourish with a Simple Philosophy: Your Content, Your Rules.” Press release, July 1, 2026. cloudflare.com
- Google Search Console Help (2026). Search generative AI control. Rolled out to all websites by August 31, 2026. support.google.com
- Google (2026). List of Google’s common crawlers, including the Google-Extended product token. Last updated October 15, 2026. developers.google.com
- Apple (2026). About Applebot, including Applebot-Extended. Published September 4, 2026. support.apple.com
- Zecchini, G., Moore, A. A., Ubl, M. and Siddle, R. (2024). “The rise of the AI crawler.” Vercel, December 17, 2024. vercel.com
- Madhavan, K., Merchant, M., Canel, F. and Nigam, S. (2026). “Introducing AI Performance in Bing Webmaster Tools Public Preview.” Microsoft Bing Webmaster Blog, February 2026. blogs.bing.com
- web.dev (2026). Web Vitals: thresholds for Largest Contentful Paint, Interaction to Next Paint and Cumulative Layout Shift. web.dev
- Google Search Central (2026). General structured data guidelines. Last updated July 10, 2026. developers.google.com
- Google Search Central (2023–2026). Search Central documentation updates: How-to rich results removed (September 2023); FAQ rich results limited to government and health sites (September 2023) and no longer shown from May 7, 2026. developers.google.com
- Howard, J. (2024). “The /llms.txt file.” Proposal, September 3, 2024. llmstxt.org
- Linehan, L. (2026). “We Analyzed 137K Sites: 97% of llms.txt Files Never Get Read.” Ahrefs, June 15, 2026. Vendor study: request logs for May 2026 from 137,210 domains. ahrefs.com
- Aggarwal, P., Murahari, V., Rajpurohit, T., Kalyan, A., Narasimhan, K. and Deshpande, A. (2024). “GEO: Generative Engine Optimization.” Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 2024). doi:10.1145/3637528.3671900
- Kim, S., Jeong, W., Kim, S., Lee, S. and Lee, D. (2026). “SAGEO Arena: A Realistic Environment for Evaluating Search-Augmented Generative Engine Optimization.” arXiv preprint 2602.12187, February 12, 2026. Not peer reviewed. arxiv.org
- Lafferty, N. (2025). “AI Platform Citation Patterns: How ChatGPT, Google AI Overviews, and Perplexity Source Information.” Profound, June 5, 2025, updated August 2025. Vendor research: about 680 million citations, August 2024 to June 2025. tryprofound.com
- xAI (2026). Tools overview: Web Search and X Search. docs.x.ai
- Google Search Console Help (2026). Generative AI performance report (Search). Rolled out to all websites by August 31, 2026. support.google.com
- OpenAI Help Center (2026). Publishers and Developers FAQ: ChatGPT search, OAI-SearchBot and utm_source=chatgpt.com. help.openai.com
Fix access first, then earn the citations
Want a second pair of eyes on your crawler settings, rendering and question set before you start? AAJ can review them against your own site.
Or start on your own with the free AI Visibility Starter Kit.
More in AI Search & Agent Readiness
Part of the AI Search & Agent Readiness hub - see all 19 resources on this topic.
- AI agent skill: GEO Citation Tracker
- AI agent skill: GEO Content Optimization
- Free tool: Schema, Meta Tag and llms.txt Generator
- AI agent skill: Structured Data for AI Search
Also useful in Content, Copy & SEO.