Billion Game
Book a strategy call

SEO BLOG

11 AEO Agency Red Flags That Mean You Are Buying Nothing [2026]

Ganesh ShanmugamGanesh Shanmugam9 min read

Spot the AEO agency red flags before you sign. Learn the AI search warning signs, from guaranteed ChatGPT placement to screenshot reports and planted mentions.

Share
11 AEO Agency Red Flags That Mean You Are Buying Nothing [2026]

A marketer who handles several Florida pool companies noticed something odd in 2026. Google rankings held steady, yet leads were drying up, because prospects had started asking ChatGPT and Perplexity who to hire. So they hired an agency selling "AEO". Four months and $4,200 later, the assistants were still recommending competitors.

Their July 2026 post on r/SEO drew more than a hundred comments, and it captures a problem many businesses now share. AI search is new, results are hard to measure, and that makes it easy to sell activity that changes nothing. Knowing the AEO agency red flags before you sign is the cheapest protection you have.

This guide covers warning signs that are specific to AI search: how pitches misuse ChatGPT, which deliverables Google itself says you can ignore, and how reports can hide the fact that nothing moved. For each one, you will also learn what to ask instead.

Key Takeaways

  • No one controls what ChatGPT says. SparkToro found less than a 1 in 100 chance that ChatGPT or Google's AI returns the same list of brands twice in 100 runs.
  • Google publishes its own list of AEO myths. Its July 2026 guide says to ignore llms.txt files, content chunking, rewriting for AI and inauthentic mentions.
  • llms.txt is not a strategy. Ahrefs found 97% of llms.txt files received zero requests in May 2026.
  • There is no special "AI schema". Google says no special schema.org markup is needed for its AI features.
  • Screenshots are not measurement. One answer from one session proves nothing when answers change on every run.
  • Rebadged SEO is the most common fake. Backlinks and meta descriptions sold as "AEO" are the pattern in the most discussed complaint of 2026.

AEO Agency Red Flags: The Short Answer

Quick answer: The biggest AEO agency red flags are guaranteed placement in ChatGPT or AI Overviews, offers to "submit" your site to AI engines, llms.txt files or "AI schema" sold as core deliverables, planted Reddit or forum mentions, and reports built on screenshots or prompt counts instead of repeated, tracked prompts. Also walk away if the agency cannot explain which crawler controls ChatGPT search, or if its "AEO" deliverables look exactly like an ordinary SEO package.

Classic SEO warning signs still apply, of course. Ownership of your accounts, fair exit terms and honest pricing are covered in our list of SEO agency red flags. The eleven signs below are the ones specific to AI search.

Why AEO Attracts Bad Offers

Three things make AI search fertile ground for poor agencies.

First, results are hard to verify. AI answers change from one run to the next, so a buyer cannot simply "check the ranking" the way they check Google.

Second, the vocabulary is new. Terms like AEO, GEO, LLM visibility and AI citations sound technical, which makes buzzwords easy to sell.

Third, Google has only recently published clear guidance. Its guide to optimising for generative AI features, updated on 10 July 2026, includes a "mythbusting" section listing popular AEO and GEO tactics that Google Search does not need. In June 2026, Google also updated its advice on hiring an SEO to suggest asking whether an agency's AEO or GEO advice aligns with that official guidance.

That question is your best filter. Most of the red flags below fail it.

Red Flags in the Pitch

1. They guarantee a place in ChatGPT or AI Overviews

A guarantee is impossible here, and the data shows why. In research published in January 2026, SparkToro asked 600 volunteers to run 12 prompts through ChatGPT, Claude and Google's AI a combined 2,961 times. It found less than a 1 in 100 chance that ChatGPT or Google's AI would give the same list of brands in any two responses, and roughly a 1 in 1,000 chance of the same order.

If the answer changes almost every time, "guaranteed top three in ChatGPT" means nothing. At best, the agency ran the prompt until it got a lucky answer.

Ask instead: "What share of runs do you expect us to appear in, across which prompts, and how will you measure it?"

2. They offer to "submit" your site to AI engines

OpenAI's route into ChatGPT search is crawler access, not a submission form. Its crawler documentation says sites that opt out of OAI-SearchBot will not be shown in ChatGPT search answers, and recommends allowing OAI-SearchBot and its published IP ranges. A "submission package" to ChatGPT, Perplexity or Gemini is paying for something that does not exist.

Ask instead: "How will you confirm that OAI-SearchBot and PerplexityBot can reach our key pages through our robots.txt, CDN and firewall?"

3. They cannot tell OAI-SearchBot from GPTBot

This is a quick competence test. OpenAI treats the two as independent settings: OAI-SearchBot is for ChatGPT search, while GPTBot collects content that may be used for training. Blocking GPTBot does not remove you from ChatGPT search, and allowing it does not put you there.

An agency that mixes them up will give you wrong advice about the most basic AI visibility setting. You can check your own file in minutes with our free robots.txt tester.

Red Flags in the Deliverables

4. llms.txt is the headline deliverable

An llms.txt file is a plain text summary of your site aimed at language models. Some agencies bill it as the centrepiece of an AEO project.

The evidence says otherwise. Google's guide states that Google Search does not use llms.txt or other "special" AI text files. Separately, Ahrefs analysed 137,000 domains and found that 97% of published llms.txt files received zero requests in May 2026. Creating one takes minutes, so it should never carry a meaningful price.

5. An "AI schema pack" appears as a line item

Structured data is useful for rich results in Google Search. However, Google's guide is explicit: structured data is not required for its generative AI features, and there is no special schema.org markup you need to add. So an upsell called "AI schema", "LLM schema" or "ChatGPT markup" is standard schema with a premium label.

Ask instead: "Which rich result or data problem will this schema fix, and how will we know?"

6. They plan to mass-produce "answer pages"

Some proposals promise hundreds of FAQ or question pages, generated quickly and "optimised for AI". Google's guide says you do not need to write in a special way for AI systems, and it asks for unique, non-commodity content that goes beyond common knowledge. Pages churned out at scale tend to be exactly the commodity content it warns against.

A handful of genuinely useful pages, written from your own expertise and data, will outperform a warehouse of thin ones.

7. They offer to "seed" Reddit, Quora or forums

AI assistants often draw on community discussions, so some agencies sell planted mentions: fake accounts praising your brand in threads. Google's guide says seeking inauthentic mentions "isn't as helpful as it might seem", because its core ranking systems focus on quality content while other systems block spam, and its AI features depend on both.

Beyond Google, community moderators remove obvious promotion, and exposed astroturfing damages the very reputation you are paying to build.

Ask instead: "Which real publications, directories, reviews or communities will mention us, and why would they?"

8. The "AEO" work is an ordinary SEO package

This is the pool business story. According to write-ups of the thread, the agency's output was mostly backlinks and meta descriptions. Those are SEO tasks, and not even the ones most linked to AI answers.

Good SEO does support AEO, since Google says its AI features are rooted in core ranking. The red flag is paying an AEO premium for work that has not changed at all. Compare the deliverables list against a standard SEO proposal. If you cannot find a single difference, you are buying a new label. Our guide to AEO pricing in India shows what legitimate work includes at each monthly price band.

Red Flags in the Reporting

9. Proof comes as screenshots

A screenshot shows one answer, from one session, on one day. Given how much answers vary, it proves almost nothing, and it is trivially easy to cherry-pick.

Real measurement runs a fixed set of prompts repeatedly across several engines, then reports the share of runs where you appear. SparkToro's research makes the same point: repeated runs can show how often a brand tends to appear, even though single answers are random.

10. They report prompt counts, not prompt results

"We are now tracking 500 prompts" sounds impressive. It is an input, not an outcome. Watch for two tricks in particular:

  • Branded prompts. Questions like "Is [your brand] a good choice?" will name you almost every time. They inflate visibility without reflecting how new buyers search.
  • Prompts nobody asks. Long, oddly specific prompts that match your page word for word are easy to "win" and worth nothing.

Ask instead: "Show me the prompt list, split into branded and unbranded, and tell me where each prompt came from."

11. The dashboard is a black box

Some agencies report a single "AI visibility score" from their own tool, with no raw data behind it. You cannot audit a number you cannot see.

Insist on data you can verify yourself. Google's guide points to the Generative AI performance report in Search Console for Google's AI features, and your own GA4 shows referral visits from AI assistants. Raw prompt-run exports should cover everything else. An independent AI citation audit can also give you a baseline that no agency controls.

AEO Red Flags at a Glance

Red flagWhere it shows upRiskWhat to ask instead
Guaranteed ChatGPT or AI Overview placementPitchHighWhat share of runs, on which prompts?
"Submit your site to AI engines"PitchHighHow will you confirm crawler access?
Confuses OAI-SearchBot and GPTBotPitchHighWhich bot controls ChatGPT search?
llms.txt as the headline deliverableProposalMedium to highWhat does Google say about it?
"AI schema pack" upsellProposalMediumWhich rich result will it fix?
Mass-produced answer pagesProposalHighWhat unique expertise goes into each page?
Planted Reddit or forum mentionsProposalHighWhich real sources will mention us?
SEO deliverables sold as AEOProposalHighWhat is different from our SEO plan?
Screenshot reportsReportingMedium to highCan we see repeated prompt runs?
Prompt-count vanity metricsReportingMediumBranded or unbranded, and from where?
Black-box visibility scoreReportingMediumCan we export the raw data?

A single high-risk flag is reason enough to walk away. Two or three medium ones together deserve the same response.

Already Signed? What to Do Next

If you recognise your current agency in this list, do not panic, and do not cancel on impulse. Instead, gather evidence first.

  1. Request the full prompt list and the raw results for every run so far.
  2. Check crawler access yourself in robots.txt and your CDN settings.
  3. Pull your own data from Search Console's Generative AI performance report and GA4 referrals.
  4. List every deliverable shipped and mark which ones Google's guide says you can ignore.
  5. Ask for a written plan for the next 90 days with measurable prompt-level targets.

If the answers are vague, use your exit clause. When you are ready to hire again, follow our process for how to choose an AEO agency.

Frequently Asked Questions

I spent $4,200 on an AEO agency and got nothing. What am I missing?

Usually, the work was ordinary SEO with an AEO label. Check whether AI crawlers can reach your site, whether your pages answer buyer questions directly, and whether anyone built genuine third-party mentions. Then measure with repeated prompt runs, not screenshots.

What is the biggest red flag when hiring an AEO agency?

A guarantee of placement in ChatGPT or Google's AI answers. SparkToro's research shows AI tools rarely give the same brand list twice, so no agency can promise a fixed position.

Are "submit your site to ChatGPT" services legitimate?

No. OpenAI's documentation describes crawler access through OAI-SearchBot as the way sites appear in ChatGPT search. Allowing that crawler is free and takes minutes.

Are most AEO agencies just doing SEO?

Many are, and that is not always bad, because Google says its AI features rest on core ranking systems. The problem is paying a premium for identical work. Genuine AEO adds AI crawler checks, multi-engine measurement and off-site reputation work.

Are answer engine optimization services worth it?

They can be, when the provider fixes access, creates useful content, earns real mentions and measures results transparently. They are not worth it when the deliverables are llms.txt files, AI schema packs or screenshots.

Final Thoughts

AEO is a real discipline, yet it is also the easiest place in marketing to sell nothing convincingly. The antidote is simple: check every pitch against Google's own guidance, insist on repeated and exportable measurement, and compare deliverables with an ordinary SEO plan.

Keep this list open during your next sales call. If an agency trips even one of these AEO agency red flags, ask the harder question, and if it cannot answer, keep looking.

Share

Ready to Hire an AI SEO Expert?

Book a free 30 minute AI Visibility Audit. We analyze your search visibility across Google, ChatGPT, Perplexity AI and AI Overviews.

About the author

Ganesh Shanmugam

Ganesh Shanmugam

Ganesh Shanmugam is an SEO and AEO consultant based in Chennai, India, and the founder of Billion Game — a boutique agency serving clients across the US, UK, Australia, Canada, and Ireland. He previously held SEO roles at 7 Eagles and Digital Scholar before going independent, and brings 4+ years of hands-on experience

More from Billion Game →

AI SEO insights in your inbox

For growth-stage brands: organic traffic, AI citations, and strategy notes. No spam—unsubscribe anytime.

By subscribing you agree to our Privacy Policy.

Related Articles

Book your free AI Visibility Audit