Agency Evaluation Guide
How to Choose an AI SEO Agency: The 5-Question Framework That Separates Real From Fake
The AI SEO agency market grew from almost nothing to a multi-billion dollar industry in under two years. That speed created a problem: most agencies in this space are traditional SEO shops that added "AI" to their name without changing what they actually do.
Methodology grounded in peer-reviewed research standards | ORCID: 0009-0002-4815-6373
We published the research these agencies cite. We analyzed 10,293 pages across 250 queries on 3 AI platforms. We know what predicts AI citation and what does not. This guide gives you a framework to tell the real agencies from the relabeled ones.
Most AI SEO Agencies Are Relabeled Traditional SEO
We know this because we published the research these agencies cite. We analyzed 10,293 pages across 250 queries on 3 AI platforms. We know what predicts AI citation and what does not. And when we read the service descriptions of agencies claiming to do AI SEO, many of them recommend the exact things our research proved do not work.
This guide gives you a framework to tell the real agencies from the relabeled ones. Five questions. If an agency cannot answer them with data, they are probably selling traditional SEO under a new name.
Can You Track Which AI Bots Crawl My Site?
What a real agency can show you:
- Real-time dashboards showing bot visits by platform (ChatGPT, Claude, Perplexity, Google AI, and 10+ others)
- Which specific pages each bot visits
- How often bots return (recrawl frequency)
- Whether bot activity is increasing or decreasing over time
| What to look for | Real AI SEO agency | Rebranded SEO agency |
|---|---|---|
| Tracks bot crawl activity | Yes, 15+ bots in real time | No |
| Explains why GA4 misses AI bots | Yes (JavaScript dependency) | Does not know |
| Can show you bot data for YOUR site | Yes, during the sales process | "We will set that up after you sign" |
The technical reality: Google Analytics and most SEO tools miss over 90% of AI bot traffic because AI bots do not execute JavaScript. Tracking AI bots requires server-side or edge middleware that logs requests at the CDN level, before they reach the browser. If an agency does not mention this, they are not tracking bots.
What Research Backs Your Recommendations?
| Popular recommendation | Sounds right? | What the data actually shows |
|---|---|---|
| "Make your site faster for AI" | Yes | Zero effect within position bands (p > 0.39) |
| "Add author bylines for trust" | Yes | No significant effect on AI citation |
| "Get more backlinks for AI visibility" | Yes | Traditional authority metrics go the WRONG direction |
| "Add more schema markup" | Yes | Generic schema presence is non-significant (p = 0.78). Only specific types help. |
| "Write longer content" | Yes | Optimal is about 2,000 words, not the 5,000+ some agencies recommend |
What a real agency can show you: Published methodology. Data from actual experiments. Sample sizes and statistical significance. Effect sizes, not just "we saw improvement."
What a fake agency says: "Our proprietary AI optimization framework" (no published methodology, no verifiable data, no way to evaluate the claims).
Red Flag Table
| Red flag | What it signals |
|---|---|
| "Proprietary AI SEO framework" with no published data | Cannot verify claims |
| Recommendations based on pre-2025 research | Field changes too fast for old data |
| Same optimization checklist as their traditional SEO service | Relabeling, not innovating |
| Cites the Princeton GEO paper without noting it does not replicate | Does not follow the research closely enough |
| Recommends "optimize for Bing" as the primary ChatGPT strategy | Our data shows 68% of ChatGPT citations come from training data, not Bing |
Do You Monitor Multiple AI Platforms?
| Platform | Search backend | Citation behavior |
|---|---|---|
| ChatGPT | Bing (via fan-out sub-queries) | Moderate citations, 95.8% third-party for brand queries |
| Perplexity | Own index (49.6% Google domain overlap) | Highest citation volume, strong freshness bias (3.3x fresher than Google) |
| Google AI Mode | Google Search infrastructure | Highest first-party rate (9%), strongest YouTube integration |
| Claude | Brave Search (86.7% overlap) | Most conservative (cites in only 39% of queries), zero Reddit, zero YouTube |
An agency that only monitors ChatGPT is missing 75% of the picture. Each platform requires different optimization because each has different architecture.
What a real agency covers: All four major platforms, with per-platform reporting.
What a fake agency says: "We check if ChatGPT mentions your brand." (One platform out of four, and likely using manual spot-checks rather than systematic measurement.)
Can You Connect AI Visibility to Revenue?
The attribution chain has four steps:
AI bot crawls your page
Tracked via edge middleware
AI cites your page
Tracked via citation monitoring
User visits your site
Tracked via referral analytics
User converts
Tracked via standard conversion tracking
Most agencies can do step 2 (check if your URL appeared in an AI answer). Few can do steps 1 and 3. Almost none can connect the full chain from crawl to conversion.
What a real agency offers: End-to-end attribution showing which AI bot crawls led to which citations led to which site visits led to which conversions.
What a fake agency says: "AI SEO increases your visibility." (True but unmeasurable without proper attribution.)
What Is Your Strategy for Third-Party Sources?
| Source type | Share of brand-query citations |
|---|---|
| Niche blogs, tools, competitors | 72.4% |
| Reddit, YouTube, LinkedIn | 16.4% |
| Review sites (Wirecutter, PCMag, RTINGS) | 7.4% |
| News and media (Forbes, Wired) | 3.8% |
| Your own website | 6.6% |
A real AI SEO strategy must include earned media, review site coverage, and Reddit/community presence. An agency that only optimizes your website is optimizing for the 6.6%.
What a real agency includes: Review site outreach, Reddit engagement strategy, competitor citation analysis, third-party mention monitoring.
What a fake agency does: Audits your meta tags, adds FAQ schema, and calls it AI SEO.
The Full Evaluation Scorecard
Use this scorecard when talking to any AI SEO agency.
| Evaluation criteria | Weight | What "good" looks like |
|---|---|---|
| AI bot crawl tracking | 25% | Real-time dashboard showing 10+ bots, per-page data |
| Research-backed methodology | 25% | Published data, sample sizes, statistical significance |
| Multi-platform monitoring | 20% | All 4 major platforms with per-platform reporting |
| Revenue attribution | 15% | Crawl-to-conversion chain, AI-attributed revenue |
| Third-party strategy | 15% | Review site outreach, Reddit, competitive citation analysis |
The Cost of Choosing Wrong
Hiring the wrong AI SEO agency does not just waste money. It wastes time during a window that is closing.
Our topical authority data shows that domains ranking for 4+ related queries cross an 87% AI citation threshold. Once a competitor builds that content cluster in your niche, they own the topical authority signal. Rebuilding it requires outranking them on multiple queries simultaneously, which is far harder than building it first.
The agencies that understand this are building content clusters for their clients right now. The agencies that do not understand this are running one-time audits and adding FAQ schema.
How AI+Automation Is Different
We do not just recommend AI SEO strategies. We publish the research that defines them.
We identified the 6 page-level features that predict AI citation. We proved that page speed does not matter. We proved that traditional authority metrics go the wrong direction. We proved that 93.4% of brand citations come from third parties. And we published all of it so anyone can verify our methodology.
BotSight: Proprietary AI bot tracking across 15+ bots, real-time edge middleware.
Full-funnel attribution: Crawl activity to citation monitoring to AI-attributed revenue.
Frequently Asked Questions
What is an AI SEO agency?
An AI SEO agency specializes in optimizing websites to appear in AI-generated search answers from ChatGPT, Perplexity, Google AI Mode, and Claude. Unlike traditional SEO agencies that focus on Google rankings, AI SEO agencies optimize for the specific content features that AI platforms use to select citation sources. The best agencies track the full pipeline from AI bot crawling to citation monitoring to revenue attribution.
How do I know if an AI SEO agency is legitimate?
Ask the five questions in this guide: Can they track AI bot crawls? What research backs their recommendations? Do they monitor multiple platforms? Can they attribute revenue? Do they have a third-party strategy? An agency that scores zero on four of five is likely a rebranded traditional SEO shop. Also check whether their recommendations align with published research. If they recommend page speed optimization for AI citation, that is a red flag (our data shows zero effect within position bands).
How much does an AI SEO agency charge?
AI SEO pricing varies widely. One-time audits typically range from $1,500 to $5,000. Monthly retainers range from $3,000 to $10,000 depending on scope (number of pages, platforms monitored, content production). Some agencies bundle AI SEO into broader marketing retainers of $10,000 to $25,000 per month. Be cautious of agencies charging premium rates for services that are functionally identical to traditional SEO with AI terminology.
Should I hire an AI SEO agency or do it myself?
If your team has the technical capability to implement server-side bot tracking, run multi-platform citation monitoring, and analyze structured data, you can do much of this work in-house using the published research as a guide. Where agencies add the most value is in (1) the monitoring infrastructure (bot tracking, citation scraping, attribution), which requires specialized tooling, and (2) the strategic layer (content cluster design, competitive analysis, vertical-specific optimization), which requires experience across many client engagements.
What results should I expect from an AI SEO agency?
Bot crawl changes are visible within days. Citation improvements typically take 2 to 8 weeks. The topical authority signal (the biggest lever) takes 3 to 6 months to build. Any agency promising immediate citation results is overpromising. The compounding nature of topical authority means that the investment pays off over time, not overnight.
Is "GEO" the same as AI SEO?
Yes. Generative Engine Optimization (GEO) is the academic term for AI SEO, introduced by researchers at Princeton in 2024. Other terms you may see include AEO (Answer Engine Optimization) and LLMO (Large Language Model Optimization). These all describe the same practice. We use "AI SEO" in client conversations because it is clearer, and "GEO" in research contexts because it has formal academic backing.
Ready to Evaluate Your AI Visibility?
Start with a free AI visibility check to see which AI bots see your site and how you score across all five evaluation criteria. Or tell us about your business and we will scope the right engagement. No call required.