Court restricts Perplexity’s AI shopping bot from accessing Amazon

Perplexity Amazon AI shopping

Perplexity AI must stop using its Comet browser agent to make purchases on Amazon. A federal judge sided with Amazon in an early ruling over AI shopping bots.

Why we care. The case targets a core promise of AI agents: completing tasks like shopping on a user’s behalf. If courts restrict how agents access sites, AI agents could face strict limits when interacting with logged-in accounts on major websites.

What happened. U.S. District Judge Maxine Chesney granted Amazon a preliminary injunction Monday in San Francisco federal court.

  • The order blocks Perplexity from using its Comet browser agent to access password-protected parts of Amazon, including Prime subscriber accounts.
  • Chesney wrote that Amazon presented “strong evidence” that Comet accessed accounts “with the Amazon user’s permission but without authorization by Amazon.”
  • The ruling also requires Perplexity to destroy any Amazon data it previously collected.

Catch-up quick. Amazon sued Perplexity in November, accusing the startup of computer fraud and unauthorized access. The company said Comet made purchases from Amazon on behalf of users without properly identifying itself as a bot.

What’s next. The order is paused for one week to allow Perplexity to appeal.

What they’re saying. Amazon spokesperson Lara Hendrickson told Bloomberg (subscription required) the injunction “will prevent Perplexity’s unauthorized access to the Amazon store and is an important step in maintaining a trusted shopping experience for Amazon customers.”

Read more at Read More

Google adds automatic end screens to video ads

How to use YouTube Ads to drive B2B conversions

Google Ads is rolling out auto end screens — a new feature that appends an interactive, auto-generated card to the end of eligible video ads to nudge viewers toward a conversion.

How it works. An interactive screen appears for a few seconds immediately after the video finishes playing.

  • Content is auto-populated from campaign data — app name, icon, price, and a direct install link for app campaigns
  • End screens appear by default on eligible ads, requiring no setup from advertisers

Why we care. Advertisers no longer need to manually build post-roll calls-to-action. This feature is on by default and changes the end of your video ads — and if you’ve already built custom YouTube end screens, they’ll be overridden without any warning. With end screens being the last thing a viewer sees before deciding to act, losing control of that moment matters.

  • And with broader expansion planned, now is the time to understand how it works before it reaches more of your campaigns.

The catch. Enabling auto end screens in Google Ads overrides any manually added YouTube end screens — meaning advertisers who’ve already customized their YouTube end cards will lose them.

Current limitations. The feature is only available for in-stream ads running in mobile app install campaigns, with broader expansion planned but not yet dated.

What stays the same. Auto end screens don’t affect billing or view counts — they’re purely an added engagement layer tacked on after a full video view.

Next steps. Advertisers running mobile app install campaigns should audit their video ads now — check whether auto end screens are serving as expected and verify that any manually added YouTube end screens aren’t being silently overridden. As Google expands the feature beyond app installs, it’s worth establishing a review process early so campaigns are ready when eligibility broadens.

Dig deeper. About auto end screens for video ads

Read more at Read More

The five infrastructure gates behind crawl, render, and index

DSCRI- The five infrastructure gates inside ‘crawl and index’

The DSCRI-ARGDW pipeline maps 10 gates between your content and an AI recommendation across two phases: infrastructure and competitive. Because confidence multiplies across the pipeline, the weakest gate is always your biggest opportunity. Here, we focus on the first five gates.

The infrastructure phase (discovery through indexing) is a sequence of absolute tests: the system either has your content, or it doesn’t. Then, as you pass through the gates, there’s degradation.

For example, a page that can’t be rendered doesn’t get “partially indexed,” but it may get indexed with degraded information, and every competitive gate downstream operates on whatever survived the infrastructure phase.

Information loss through infrastructure gates

If the raw material is degraded, the competition in the ARGDW phase starts with a handicap that no amount of content quality can overcome.

The industry compressed these five distinct DSCRI gates into two words: “crawl and index.” That compression hides five separate failure modes behind a single checkbox. This piece breaks the simplistic “crawl and index” into five clear gates that will help you optimize significantly more effectively for the bots.

If you’re a technical SEO, you might feel you can skip this. Don’t.

You’re probably doing 80% of what follows and missing the other 20%. The gates below provide measurable proof that your content reached the index with maximum confidence, giving it the best possible chance in the competitive ARGDW phase that follows.

Sequential dependency: Fix the earliest failure first

The infrastructure gates are sequential dependencies: each gate’s output is the next gate’s input, and failure at any gate blocks everything downstream. 

If your content isn’t being discovered, fixing your rendering is wasted effort, and if your content is crawled but renders poorly, every annotation downstream inherits that degradation. Better to be a straight C student than three As and an F, because the F is the gate that kills your pipeline.

The audit starts with discovery and moves forward. The temptation to jump to the gate you understand best (and for many technical SEOs, that’s crawling) is the temptation that wastes the most money.

Your customers search everywhere. Make sure your brand shows up.

The SEO toolkit you know, plus the AI visibility data you need.

Start Free Trial
Get started with

Semrush One Logo

Discovery, selection, crawling: The three gates the industry already knows

Discovery and crawling are well-understood, while selection is often overlooked.

Discovery is an active signal. Three mechanisms feed it: 

  • XML sitemaps (the census).
  • IndexNow (the telegraph).
  • Internal linking (the road network). 

The entity home website is the primary discovery anchor for pull discovery, and confidence is key. The system asks not just “does this URL exist?” but “does this URL belong to an entity I already trust?” Content without entity association arrives as an orphan, and orphans wait at the back of the queue.

The push layer (IndexNow, MCP, structured feeds) changes the economics of this gate entirely, and I’ll explain what changes when you stop waiting to be found and start pushing.

Selection is the system’s opinion of you, expressed as crawl budget. As Microsoft Bing’s Fabrice Canel says, “Less is more for SEO. Never forget that. Less URLs to crawl, better for SEO.” 

The industry spent two decades believing more pages equals more traffic. In the pipeline model, the opposite is true: fewer, higher-confidence pages get crawled faster, rendered more reliably, and indexed more completely. Every low-value URL you ask the system to crawl is a vote of no confidence in your own content, and the system notices.

Not every page that’s discovered in the pull model is selected. Canel states that the bot assesses the expected value of the destination page and will not crawl the URL if the value falls below a threshold.

Crawling is the most mature gate and the least differentiating. Server response time, robots.txt, redirect chains: solved problems with excellent tooling, and not where the wins are because you and most of your competition have been doing this for years. 

What most practitioners miss, and what’s worth thinking about: Canel confirmed that context from the referring page carries forward during crawling.

Your internal linking architecture isn’t just a crawl pathway (getting the bot to the page) but a context pipeline (telling the bot what to expect when it arrives), and that context influences selection and then interpretation at rendering before the rendering engine even starts.

Rendering fidelity: The gate that determines what the bot sees

Rendering fidelity is where the infrastructure story diverges from what the industry has been measuring.

After crawling, the bot attempts to build the full page. It sometimes executes JavaScript (don’t count on this because the bot doesn’t always invest the resources to do so), constructs the document object model (DOM), and produces the rendered DOM.

I coined the term rendering fidelity to name this variable: how much of your published content the bot actually sees after building the page. Content behind client-side rendering that the bot never executes isn’t degraded, it’s gone, and information the bot never sees can’t be recovered at any downstream gate. 

Every annotation, every grounding decision, every display outcome depends on what survived rendering. If rendering is your weakest gate, it’s your F on the report card, and remember: everything downstream inherits that grade.

The friction hierarchy: Why the bot renders some sites more carefully than others

The bot’s willingness to invest in rendering your page isn’t uniform. Canel confirmed that the more common a pattern is, the less friction the bot encounters. 

I’ve reconstructed the following hierarchy from his observations. The ranking is my model. The underlying principle (pattern familiarity reduces selection, crawl, rendering, and indexing friction and processing cost) is confirmed:

Approach Friction level Why
WordPress + Gutenberg + clean theme Lowest 30%+ of the web. Most common pattern. Bot has highest confidence in its own parsing.
Established platforms (Wix, Duda, Squarespace) Low Known patterns, predictable structure. Bot has learned these templates.
WordPress + page builders (Elementor, Divi) Medium Adds markup noise. Downstream processing has to work harder to find core content.
Bespoke code, perfect HTML5 Medium-High Bot does not know your code is perfect. It has to infer structure without a pattern library to validate against.
Bespoke code, imperfect HTML5 High Guessing with degraded signals.

The critical implication, also from Canel, is that if the site isn’t important enough (low publisher entity authority), the bot may never reach rendering because the cost of parsing unfamiliar code exceeds the estimated benefit of obtaining the content. Publisher entity confidence has a huge influence on whether you get crawled and also how carefully you get rendered (and everything else downstream).

JavaScript is the most common rendering obstacle, but it isn’t the only one: missing CSS, proprietary elements, and complex third-party dependencies can all produce the same result — a bot that sees a degraded version of what a human sees, or can’t render the page at all.

JavaScript was a favor, not a standard

Google and Bing render JavaScript. Most AI agent bots don’t. They fetch the initial HTML and work with that. The industry built on Google and Bing’s favor and assumed it was a standard.

Perplexity’s grounding fetches work primarily with server-rendered content. Smaller AI agent bots have no rendering infrastructure.

The practical consequence: a page that loads a product comparison table via JavaScript displays perfectly in a browser but renders as an empty container for a bot that doesn’t execute JS. The human sees a detailed comparison. The bot sees a div with a loading spinner. 

The annotation system classifies the page based on an empty space where the content should be. I’ve seen this pattern repeatedly in our database: different systems see different versions of the same page because rendering fidelity varies by bot.

Three rendering pathways that bypass the JavaScript problem

The traditional rendering model assumes one pathway: HTML to DOM construction. You now have two alternatives.

Three rendering pathways that bypass the JavaScript problem

WebMCP, built by Google and Microsoft, gives agents direct DOM access, bypassing the traditional rendering pipeline entirely. Instead of fetching your HTML and building the page, the agent accesses a structured representation of your DOM through a protocol connection.

With WebMCP, you give yourself a huge advantage because the bot doesn’t need to execute JavaScript or guess at your layout, because the structured DOM is served directly.

Markdown for Agents uses HTTP content negotiation to serve pre-simplified content. When the bot identifies itself, the server delivers a clean markdown version instead of the full HTML page. 

The semantic content arrives pre-stripped of everything the bot would have to remove anyway (navigation, sidebars, JavaScript widgets), which means the rendering gate is effectively skipped with zero information loss. If you’re using Cloudflare, you have an easy implementation that they launched in early 2026.

Both alternatives change the economics of rendering fidelity in the same way that structured feeds change discovery: they replace a lossy process with a clean one. 

For non-Google bots, try this: disable JavaScript in your browser and look at your page, because what you see is what most AI agent bots see. You can fix the JavaScript issue with server-side rendering (SSR) or static site generation (SSG), so the initial HTML contains the complete semantic content regardless of whether the bot executes JavaScript. 

But the real opportunity lies in new pathways: one architectural investment in WebMCP or Markdown for Agents, and every bot benefits regardless of its rendering capabilities.

Get the newsletter search marketers rely on.


Conversion fidelity: Where HTML stops being HTML

Rendering produces a DOM. Indexing transforms that DOM into the system’s proprietary internal format and stores it. Two things happen here that the industry has collapsed into one word.

Rendering fidelity (Gate 3) measures whether the bot saw your content. Conversion fidelity (Gate 4) measures whether the system preserved it accurately when filing it away. Both losses are irreversible, but they fail differently and require different fixes.

The strip, chunk, convert, and store sequence

What follows is a mechanical model I’ve reconstructed from confirmed statements by Canel and Gary Illyes.

Strip: The system removes repeating elements: navigation, header, footer, and sidebar. Canel confirmed directly that these aren’t stored per page. 

The system’s primary goal is to find the core content. This is why semantic HTML5 matters at a mechanical level. <nav>, <header>, <footer>, <aside>, <main>, and <article> tags tell the system where to cut. Without semantic markup, it has to guess. 

Illyes confirmed at BrightonSEO in 2017 that finding core content at scale was one of the hardest problems they faced.

Chunk: The core content is broken into segments: text blocks, images with associated text, video, and audio. Illyes described the result as something like a folder with subfolders, each containing a typed chunk (he probably used the term “passage” — potato, potarto, tomato, tomarto). The page becomes a hierarchical structure of typed content blocks.

Convert: Each chunk is transformed into the system’s proprietary internal format. This is where semantic relationships between elements are most vulnerable to loss. 

The internal format preserves what the conversion process recognizes, and everything else is discarded.

Store: The converted chunks are stored in a hierarchical structure. 

The wrapper hierarchy - How your content is stored

The individual steps are confirmed. The specific sequence and the wrapper hierarchy model are my reconstruction of how those confirmed pieces fit together.

In this model, the repeating elements stripped in the first step are not discarded but stored at the appropriate wrapper level: navigation at site level, category elements at category level. The system avoids redundancy by storing shared elements once at the highest applicable level.

Like my “Darwinism in search” piece from 2019, this is a well-informed, educated guess. And I’m confident it will prove to be substantively correct.

The wrapper hierarchy changes three things you already do:

URL structure and categorization: Because each page inherits context from its parent category wrapper, URL structure determines what topical context every child page receives during annotation (the first gate in the phase I’ll cover in the next article: ARGDW).

A page at /seo/technical/rendering/ inherits three layers of topical context before the annotation system reads a single word. A page at /blog/post-47/ inherits one generic layer. Flat URL structures and miscategorized pages create annotation problems that might appear to be content problems.

Breadcrumbs validate that the page’s position in the wrapper hierarchy matches the physical URL structure (i.e., match = confidence, mismatch = friction). Breadcrumbs matter even when users ignore them because they’re a structural integrity signal for the wrapper hierarchy.

Meta descriptions: Google’s Martin Splitt suggested in a webinar with me that the meta description is compared to the system’s own LLM-generated summary of the page. If they match, a slight confidence boost. If they diverge, no penalty, but a missed validation opportunity.

Where conversion fidelity fails

Conversion fidelity fails when the system can’t figure out which parts of your page are core content, when your structure doesn’t chunk cleanly, or when semantic relationships fail to survive format conversion.

The critical downstream consequence that I believe almost everyone is missing: indexing and annotation are separate processes. 

A page can be indexed but poorly annotated (stored but semantically misclassified). I’ve watched it happen in our database: a page is indexed, it’s recruited by the algorithmic trinity, and yet the entity still gets misrepresented in AI responses because the annotation was wrong. 

The page was there. The system read it. But it read a degraded version (rendering fidelity loss at Gate 3, conversion fidelity loss at Gate 4) and filed it in the wrong drawer (annotation failure at Gate 5).

Processing investment: Crawl budget was only the beginning

The industry built an entire sub-discipline around crawl budget. That’s important, but once you break the pipeline into its five DSCRI gates, you see that it’s just one piece of a larger set of parameters: every gate consumes computational resources, and the system allocates those resources based on expected return. This is my generalization of a principle Canel confirmed at the crawl level.

Gate Budget type What the system asks
1 (Selected) Crawl budget “Is this URL a candidate for fetching?”
2 (Crawled) Fetch budget “Is this URL worth fetching?”
3 (Rendered) Render budget “Is this page a candidate for rendering?”
4 (Indexed) Chunking/conversion budget “Is this content worth carefully decomposing?”
5 (Annotated) Annotation budget “Is this content worth classifying across all dimensions?”

Each budget is governed by multiple factors: 

  • Publisher entity authority (overall trust).
  • Topical authority (trust in the specific topic the content addresses).
  • Technical complexity.
  • The system’s own ROI calculation against everything else competing for the same resource. 

The system isn’t just deciding whether to process but how much to invest. The bot may crawl you but render cheaply, render fully but chunk lazily, or chunk carefully but annotate shallowly (fewer dimensions). Degradation can occur at any gate, and the crawl budget is just one example of a general principle.

Structured data: The native language of the infrastructure gates

The SEO industry’s misconceptions about structured data run the full spectrum:

  • The magic bullet camp that treats schema as the only thing they need.
  • The sticky plaster camp that applies markup to broken pages, hoping it compensates for what the content fails to communicate.
  • The ignore-it-entirely camp that finds it too complicated or simply doesn’t believe it moves the needle.

None of those positions is quite right.

Structured data isn’t necessary. The system can — and does — classify content without it. But it’s helpful in the same way the meta description is: it confirms what the system already suspects, reduces ambiguity, and builds confidence.

The catch, also like the meta description, is that it only works if it’s consistent with the page. Schema that contradicts the content doesn’t just fail to help: it introduces a conflict the system has to resolve, and the resolution rarely favors the markup.

When the bot crawls your page, structured data requires no rendering, interpretation, or language model to extract meaning. It arrives in the format the system already speaks: explicit entity declarations, typed relationships, and canonical identifiers.

In my model, this makes structured data the lowest-friction input the system processes, and I believe it’s processed before unstructured content because it’s machine-readable by design. Semantic HTML tells the system which parts carry the primary semantic load, and semantic structure is what survives the strip-and-chunk process best because it maps directly to the internal representation.

Schema at indexing works the same way: instead of requiring the annotation system to infer entity associations and content types from unstructured text, schema declares them explicitly, like a meta description confirming what the page summary already suggested.

The system compares, finds consistency, and confidence rises. The entire pipeline is a confidence preservation exercise: pass each gate and carry as much confidence forward as possible. Schema is one of the cleaner tools for protecting that confidence through the infrastructure phase.

That said, Canel noted that Microsoft has reduced its reliance on schema. The reasons are worth understanding:

  • Schema is often poorly written.
  • It has attracted spam at a scale reminiscent of keyword stuffing 25 years ago.
  • Small language models are increasingly reliable at inferring what schema used to need to declare explicitly.

Schema’s value isn’t disappearing, but it’s shifting: the signal matters most where the system’s own inference is weakest, and least where the content is already clean, well-structured, and unambiguous.

Schema and HTML5 have been part of my work since 2015, and I’ve written extensively about them over the years. But I’ve always seen structured data as one tool among many for educating the algorithms, not the answer in itself. That distinction matters enormously.

Brand is the key, and for me, always has been.

Without brand, all the structured data in the world won’t save you. The system needs to know who you are before it can make sense of what you’re telling it about yourself.

Schema describes the entity and brand establishes that the entity is worth describing. Get that order wrong, and you’re decorating a house the system hasn’t decided to visit yet.

The practical reframe: structured data implementation belongs in the infrastructure audit, and it’s the format that makes feeds and agent data possible in the first place. But it’s a confirmation layer, not a foundation, and the system will trust its own reading over yours if the two diverge.

Why improve infrastructure when you can skip them entirely?

The multiplicative nature of the pipeline means the same logic that makes your weakest gate your biggest problem also makes gate-skipping your biggest opportunity.

If every gate attenuates confidence, removing a gate entirely doesn’t just save you from one failure mode: it removes that gate’s attenuation from the equation permanently.

To make that concrete, here’s what the math looks like across seven approaches. The base case assumes 70% confidence at every gate, producing a 16.8% surviving signal across all five in DSCRI. Where an approach improves a gate, I’ve used 75% as the illustrative uplift.

These are invented numbers, not measurements. The point is the relative improvement, not the figures themselves.

Entry modes- Which gates your content passes through
Approach What changes Entering ARGDW with
Pull (crawl) Nothing 16.8%
Schema markup I → 75% 18.0%
WebMCP R skipped 24.0%
IndexNow D skipped, S → 75% 25.7%
IndexNow + WebMCP D skipped, S → 75%, R skipped 36.8%
Feed (Merchant Center, Product Feed) D, S, C, R skipped 70.0%
MCP (direct agent data) D, S, C, R, I skipped 100%

The infrastructure phase is pre-competitive. The annotation, recruited, grounded, displayed, and won (ARGDW) gates are where your content competes against every alternative the system has indexed. Competition is multiplicative too, so what you carry into annotation is what gets multiplied.

A brand that navigated all five DSCRI gates with 70% enters the competitive phase with 16.8% confidence intact. A brand on a feed enters with 70%. A brand on MCP enters with 100%. The competitive phase hasn’t started yet, and the gap is already that wide.

There’s an asymmetry worth naming here. Getting through a DSCRI gate with a strong score is largely within your control: the thresholds are technical, the failure modes are known, and the fixes have playbooks. 

Getting through an ARGDW gate with a strong score depends on how you compare to all the alternatives in the system. The playbooks are less well developed, some don’t exist at all (annotation, for example), and you can’t control the comparison directly — you can only influence it.

Which means the confidence you carry into annotation is the only part of the competitive phase you can fully engineer in advance.

Optimizing your crawl path with schema, WebMCP, IndexNow, or combinations of all three will move the needle, and the table above shows by how much. But a feed or MCP connection changes what game you’re playing.

Every content type benefits from skipping gates, but the benefit scales with the business stakes at the end of the pipeline, and nothing has more at stake than content where the end goal is a commercial transaction.

The MCP figure represents the best case for the DSCRI phase: direct data availability bypasses all five infrastructure gates. In practice, the number of gates skipped depends on what the MCP connection provides and how the specific platform processes it. The principle holds: every gate skipped is an exclusion risk avoided and potential attenuation removed before competition starts.

A product feed is only the first rung. Andrea Volpini walked me through the full capability ladder for agent readiness:

  • A feed gives the system inventory presence (it knows what exists).
  • A search tool gives the agent catalog operability (it can search and filter without visiting the website).
  • An action endpoint tips the model from assistive to agentic — the agent doesn’t just recommend the transaction, it closes it.
The agent readiness ladder

That distinction is what I built AI assistive agent optimization (AAO) around: engineering the conditions for an agent to act on your behalf, not just mention you.

Volpini’s ladder makes the mechanic concrete: each rung skips more gates, removes more exclusion risk, and eliminates more potential attenuation before competition starts. A brand with all three is playing a different game from a brand that’s still waiting for a bot to crawl its product pages.

Note: Always keep this in mind when optimizing your site and content — make your content friction-free for bots and tasty for algorithms.

See the complete picture of your search visibility.

Track, optimize, and win in Google and AI search from one platform.

Start Free Trial
Get started with

Semrush One Logo

DSCRI are absolute tests, ARGDW are competitive tests. The pivot is annotation.

Five gates. Five absolute tests. Pass or fail (and a degrading signal even on pass).

The solutions are well documented:

  • Discovery failures fixed with sitemaps and IndexNow.
  • Selection failures with pruning and entity signal clarity.
  • Crawling failures with server configuration.
  • Rendering failures with server-side rendering or the new pathways that bypass the problem entirely.
  • Indexing failures with semantic HTML, canonical management, and structured data.

The infrastructure phase is the only phase with a playbook, and opportunity cost is the cheapest failure pattern to fix.

But DSCRI is only half the pipeline, and it’s the easiest to deal with.

After indexing, the scoreboard turns on. The five competitive gates (ARGDW) are competitive tests: your content doesn’t just need to pass, it needs to beat the competition. What your content carries into the kickoff stage of those competitive gates is what survived DSCRI. And the entry gate to ARGDW is annotation. 

The next piece opens annotation: the gate the industry has barely begun to address. It’s where the system attaches sticky notes to your indexed content across 24+ dimensions, and every algorithm in the ARGDW phase uses those notes to decide what your content means, who it’s for, and whether it deserves to be recruited, grounded, displayed, and recommended.

Those sticky notes are the be-all and end-all of your competitive position, and almost nobody knows they exist.

In “How the Bing Q&A / Featured Snippet Algorithm Works,” in a section I titled “Annotations are key,” I explained what Ali Alvi told me on my podcast, “Fabrice and his team do some really amazing work that we actually absolutely rely on.”

He went further: without Canel’s annotations, Bing couldn’t build the algos to generate Q&A at all. A senior Microsoft engineer, on the record, in plain language.

The evidence trail has been there for six years. That, for me, makes annotation the biggest untapped opportunity in search, assistive, and agential optimization right now.

This is the third piece in my AI authority series. 

Read more at Read More

The infinite tail: When search demand moves beyond keywords

The infinite tail- When search demand moves beyond keywords

When people speak naturally, their language flows. It’s often messy, incomplete, and not especially coherent. The Google search bar, however, required something different. Users had to compress their needs into short phrases or slightly longer queries — what’s traditionally classified as short-tail or long-tail.

To make that work, users stacked queries across a journey, moving through a funnel from A to B and refining as they went. In the process, users often stripped out personalized nuance to match what they believed the search engine could understand. In response, SEO professionals built systems around that constraint, grouping queries by search volume, categorizing them by a limited set of intents, and measuring competitiveness.

That dynamic is changing. SEOs need to understand the behavioral change that’s emerging. Google is promoting Gemini, and phone manufacturers like Samsung are marketing AI-enabled features as product USPs. Alongside this product marketing, there’s also a level of education happening. Users are being encouraged to be more expressive with their queries, personalize their searches, and describe what they’re looking for in greater depth.

Long-tail query on Google search bar

Moving from keyword research to prompt research

This is where we need to move away from the notion of keyword research to prompt research. Keyword research traditionally assumes that demand can be quantified, that variations can be listed and grouped, and that optimization happens at a phrase level or a cluster level. In the new hybrid AI and organic search world, demand is much more of a generative concept. Prompts can be written in countless ways while preserving the same underlying need. 

This doesn’t make keyword research obsolete, but it does change its focus. Instead of extracting keywords from tools as we’ve done, we also need to start understanding and modeling journeys. Instead of grouping by volume alone, we need to group by decision stage and the type and level of uncertainty the user has.

The output of this process isn’t simply a keyword map, but a task map that accurately reflects the real pressures and constraints experienced by the audience. This is an evolution from short-tail and long-tail keyword research to an infinite tail of prompt research.

Dig deeper: Why AI optimization is just long-tail SEO done right

Your customers search everywhere. Make sure your brand shows up.

The SEO toolkit you know, plus the AI visibility data you need.

Start Free Trial
Get started with

Semrush One Logo

The infinite tail as a behavioral shift

You can describe the infinite tail as an expansion of the long tail. But that underestimates what’s actually changing. It’s not just about more niche phrases or longer query strings. It’s about the level of personalization that’s been layered into each request.

As users add context, constraints, and preferences, prompts become unique combinations of a multitude of factors. The number of possible combinations effectively becomes infinite, even if the underlying tasks remain finite. AI systems respond by evaluating the given prompts and probabilistically predicting the next tokens rather than using exact-match strings.

It’s less about how you rank for a specific keyword or whether you’re visible in AI for a specific phrase. It becomes whether your content has the highest probability of satisfying the situation being described. That’s a different optimization problem altogether. You’re not competing on phrasing. You’re competing on task completion.

This part of the journey is where “fuzzy searches” happen, meaning the path isn’t a straight line. Success isn’t just about finishing a task. It’s about making sure the user actually found what they were looking for. Since every user moves differently, the process is flexible rather than a set of rigid steps.

Dig deeper: From search to answer engines: How to optimize for the next era of discovery

Get the newsletter search marketers rely on.


Fan-out and grounding queries

One of the most important mechanics in AI search is query fan-out. When a complex prompt is submitted, the system doesn’t treat it as a single string. Instead, it decomposes a request into a network of subquestions, classifications, and checks that together form a broader evaluation framework.

From an SEO perspective, this means your content moves beyond evaluation against a single phrase or specific document matches. Instead, it’s assessed across a network of related questions, with a collective determination of whether it can satisfy a broader task. 

In a fan-out world, you win by supporting the entire decision cluster that surrounds that term. If your content addresses only one narrow dimension of the task, it becomes fragile. If it supports multiple layers of the decision, it becomes resilient. Fan-out rewards structural coverage and contextual relevance rather than repetition of specific phrases.

Grounding queries help provide the LLM with a level of confidence through its fan-created queries. AI systems generate answers and attempt to validate them.

They’re used to check whether a proposed answer is supported elsewhere, whether claims are consistent across sources, and whether the entity behind the information is reputable. If an AI system includes your brand in a summarized response, it needs a level of confidence to defend it virtually if challenged by alternative information.

This changes the meaning of authority. In traditional SEO, ranking could be achieved through technical content, links, and other forms of manipulation. In AI search, selection also depends on how easily your content can be corroborated against a broader consensus within the cohort. This can involve factors tied to entity clarity, including structure, data consistency, consistent messaging, and external validation. These signals reduce uncertainty for the system. You’re not just trying to appear. You’re trying to be selected and defended.

Dig deeper: The authority era: How AI is reshaping what ranks in search

Designing for hybrid search

Organic search isn’t disappearing. Ranking still influences discovery, technical SEO still shapes crawlability, and architecture still determines how well a site and its content are understood. 

But now, AI layers sit on top, synthesizing information and influencing which brands are surfaced within conversational responses. In this hybrid environment, organic visibility feeds AI selection. They aren’t exclusive, and yet they aren’t codependent. 

AI selection can reinforce brand perception, and fan-out rewards depth of current coverage. Grounding then rewards trust and consistency. This is where the infinite tail rewards genuine audience understanding and the creation of websites and content systems that support it.

This is a shift from keyword research to prompt research, and not just a cosmetic renaming of the process. Success will depend on understanding why people search, the decisions they’re making, the uncertainties they face, and the evidence they need before committing. Search increasingly revolves around satisfying situations rather than matching strings. Designing for the infinite tail means designing for people and the tasks they’re trying to complete.

Dig deeper: How to use AI response patterns to build better content

Read more at Read More

Web Design and Development San Diego

Content alone isn’t enough: Why SEO now requires distribution

Why AI search is making distribution as important as content in SEO

“Content is king” remains one of the most widely accepted ideas in SEO. Not everyone has agreed. Different schools of thought have always existed, with some practitioners prioritizing backlinks and others focusing on technical SEO.

Content is often treated as the primary driver of search visibility. I’m not arguing that.

My point is simpler: if you’ve relied on content to drive results — and earn a living — you should start doubling down on distribution.

With AI search changing the game, creating great content (and, yes, building some backlinks) is no longer enough to get it seen. The more important question may no longer be “What should I write next?” but “Where should I push this next?”

AI tools are further fragmenting search

Content distribution has become far more important in recent years, especially as audiences spread across more online spaces. In many teams, this job was usually outsourced to someone other than SEOs:

  • Social media managers.
  • Community managers.
  • PR specialists.
  • Various assistants and interns.

Sure, distribution held some value to SEO, but it was generally considered more beneficial to other functions.

Thanks to AI search, it’s finally landed squarely on our plate. Since AI models have fragmented search to an unprecedented level, distribution is now key to meaningful SEO outcomes.

There are three key drivers behind this change:

  • Different tools have different sourcing logic.
  • AI tools source differently from traditional search.
  • Their logic is changeable.

If this all sounds a bit abstract, let’s briefly dig into the evidence and explain what’s really going on.

Different tools have different sourcing logic

Search is fragmenting as people use a wider range of tools. Ideally, one strategy would work everywhere, but research shows that’s not the case.

AI search tools cite different sources, a 2025 Search Atlas study found. Some show significantly more overlap with the SERPs than others. This indicates that different tools follow different sourcing logic. And as long as that’s true, optimizing for one won’t necessarily boost visibility on another.

The whole thing is even trickier because users seem more open to switching tools than before. Gemini may soon surpass formerly unrivaled ChatGPT in traffic share, according to Similarweb. That could change again quickly.

Thinking there’s a single clear winner, like Google used to be, would be wrong. Focusing on the most popular tool at the moment isn’t a guaranteed strategy.

To maximize visibility, we need to consider how multiple AI tools source their information, which implies our distribution strategy needs to be broad.

Dig deeper: Tracking AI search citations: Who’s winning across 11 industries

Your customers search everywhere. Make sure your brand shows up.

The SEO toolkit you know, plus the AI visibility data you need.

Start Free Trial
Get started with

Semrush One Logo

AI search uses different logic from traditional search

The Search Atlas study showed that some AI search tools overlap with Google more than others — but in all cases, the overlap is pretty low. Perplexity ranked the highest at 43%, while ChatGPT barely hit 21%.

Characterizing Web Search in The Age of Generative AI (PDF) explicitly finds that AI search tools draw from a much wider pool of sources and are more likely to cite sites with fewer visits than traditional search engines.

This shows us that fragmentation is compounding. The pool of potential sources is wider, with little overlap among AI tools or between AI and traditional search.

The sourcing logic is changeable

The most problematic factor out of all, though, is that the sourcing logic of one tool can and often does change, too. This leads to different domains getting cited for the same prompts at different points in time — a phenomenon called citation drift.

Citation drift is more frequent than we might assume. Over the course of just a month, for instance, AI tools change approximately 40-60% of the domains they cite for the same prompt, according to Profound.

In other words, one domain could appear several times in a single response, then disappear completely the following month. This flip-flopping gets even worse over longer periods. For example, Profound’s study also showed that, from January to July, as many as 70% to 90% of the domains cited for the same prompt had changed.

Get the newsletter search marketers rely on.


Focus on broad, multi-channel distribution

Search is fragmented across tools and time. As cited domains change more frequently, users see more sources, making it even harder for you to push your brand to the front.

So, what can we do about it? How should we approach this increasing fragmentation of search?

While this might change as new tools and strategies emerge, the best answer we have so far is this: focus on broad, multi-channel distribution.

When you can’t reliably predict which sources will be used, the best strategy is to widen your footprint. This creates more potential entry points into AI systems’ training and retrieval layers.

Distribution also matters for another reason. AI tools often prefer third-party sources over branded domains, according to an AirOps study.

This will require some serious shifts in how many SEOs approach their work. Here are a few you can implement right away.

1. Get good at collaborating

You’re unlikely to win fragmented AI search on your own. Optimizing for it now takes a much broader approach than before, pulling in digital PR, social media, community management, and other functions.

Those areas require skills many SEOs don’t have. Those who do still have only 24 hours in a day, so spreading that work across multiple disciplines isn’t realistic.

This only works with a team. You might hate that idea, especially because it means giving up full control of your projects and results. I get it, but that’s the reality right now. You’ll have to let some things go, trust others to handle them, and divide responsibilities. In other words, you’ll need to collaborate efficiently.

Dig deeper: Why 2026 is the year the SEO silo breaks and cross-channel execution starts

2. Broaden your skillset

Even if you let experts handle certain tasks, you’ll still need at least a surface-level understanding of other disciplines becoming central to search.

SEOs will still own at least parts of distribution, whether that means handling the high-level strategy or downright executing it on specific channels.

In either case, doing this well requires skills you may not have used much before. So now’s the time to develop them.

That could mean learning more about digital PR, partnerships, thought leadership, syndication, community presence, or something else. With so many possibilities, it helps to start with the area you feel most comfortable with or most drawn to at the moment.

3. Shift your mindset from ranking to presence

You also need to change how you think about SEO, and then translate that shift into actual workflows. Google is still a major traffic driver, and rankings still matter. But for a fragmented, AI-driven search, obsessing over rank won’t cut it.

Instead of asking, “How do I get this content to rank?” You now need to ask, “How do I get this content into as many places as possible?”

Again, the goal is to create multiple entry points across AI systems, platforms, and audiences, increasing the chances of your content getting discovered, cited, and surfaced.

That’s why it’s important to start thinking more about overall presence across ecosystems rather than just positions in specific search engines.

4. Redesign your workflow

If you’ve successfully shifted your mindset from ranking to presence, it’s time to build a workflow that reflects that change.

I know firsthand how easy it is to forget about distribution, especially if it wasn’t part of your process before. To make it stick, you need to redesign your workflow to position distribution at the core.

A good place to start is by adding a launch phase, where content is distributed immediately upon publishing. After that, you could include a recurring phase every few months to ensure you regularly refresh and redistribute content.

Define reusable details upfront, like which channels you’ll consistently target and who owns each one. That way, you’ll minimize planning from scratch and make sure nothing falls through the cracks.

Dig deeper: Content marketing in an AI era: From SEO volume to brand fame

5. Start with these easy-to-implement best practices

Finally, if you want some easy tactics to immediately add to your to-do list, consider these:

  • Pilot content partnerships, starting where it’s easiest. Usually, that implies reaching out to existing business partners first.
  • Proactively distribute your content on third-party sites, whether that means syndicating it or repurposing it for Quora and LinkedIn.
  • Pay attention to where AI tools already pull from. While sourcing logic changes constantly, you may still notice recurring patterns worth leveraging.
  • Give a special push to your existing, older content to counteract the pitfalls of citation drift. Reintroduce it on new channels, or work to get it referenced in new places.

See the complete picture of your search visibility.

Track, optimize, and win in Google and AI search from one platform.

Start Free Trial
Get started with

Semrush One Logo

Rethinking SEO processes for fragmented AI search

The shifts are large enough that you’ll need to rethink how you do SEO. As search fragments, the work itself will have to evolve.

The approaches and workflows you relied on in the past won’t translate cleanly into a landscape shaped by multiple AI tools, changing sourcing logic, and constantly shifting citations.

These processes will also become more complex because they require closer collaboration with other teams. Distribution now intersects with digital PR, social media, partnerships, and community management, making cross-team coordination more important than before.

There’s a long road ahead. The best way to keep your sanity is to start small: focus on manageable steps, take them one at a time, and build from there.

Read more at Read More

Web Design and Development San Diego

Why tomorrow’s media leaders must think like product managers

Why tomorrow’s media leaders must think like product managers

If you’ve been in marketing long enough, you’ve probably lived through a few identity crises. First, we were channel experts. Then, we became integrated marketers, growth marketers, and performance marketers. Somewhere along the way, someone added “AI” to everyone’s job description and called it a day.

Now, we’re entering the era of the full-stack marketer. From where I sit — particularly as a media leader — the role is starting to look a lot like product management.

This doesn’t mean you need to start writing Jira tickets for fun (though some of you already do). It means that tomorrow’s most effective media leaders won’t just optimize campaigns. They’ll own outcomes, connect dots across teams, and think holistically about the entire user experience, from first impression to final conversion (and beyond).

I’ve seen this shift most clearly in industries with long consideration cycles, multiple stakeholders, and rising acquisition costs — where marketing performance is inseparable from the experience itself.

Let’s break down what’s driving the rise of the full-stack marketer, what it really means to “think like a product manager,” and why this mindset is becoming non-negotiable for media leaders.

What is a full-stack marketer, anyway?

A full-stack marketer isn’t someone who does everything (burnout isn’t a job requirement). Instead, it’s someone who understands how everything works together.

Over the course of my career, I’ve learned that the most impactful media decisions rarely come from being the deepest expert in one area. They come from having working fluency across many:

  • Media and channels: Paid search, paid social, programmatic, CTV, SEO, email, SMS, and whatever new acronym launches next quarter.
  • Creative and messaging: Knowing what resonates, where, and why.
  • Data and analytics: Not just reading dashboards, but asking better questions of the data.
  • UX and CRO: Understanding friction, intent, and user behavior.
  • Technology and platforms: CRMs, CMSs, marketing automation, and attribution tools.

The full-stack marketer doesn’t need to be the deepest expert in every area, but they do need to know enough to connect insights, spot gaps, and make informed trade-offs. In practice, this means constantly zooming out to see the system and zooming back in when something breaks.

Your customers search everywhere. Make sure your brand shows up.

The SEO toolkit you know, plus the AI visibility data you need.

Start Free Trial
Get started with

Semrush One Logo

Why media leaders are evolving into product thinkers

Earlier in my career, media leadership was often defined by questions like:

  • Are we hitting CPA targets?
  • Which channels are driving the most conversions?
  • How do we allocate budget more efficiently?

Those questions still matter. I ask them all the time. But over the years, I’ve learned they’re no longer sufficient on their own. Today’s environment forces media leaders to grapple with bigger, messier questions:

  • Why are conversion rates declining even when traffic is strong?
  • Where are prospects dropping out of the funnel,  and why?
  • How does media performance change when the application experience changes?
  • What happens after the lead submits?

These are product questions. Product managers obsess over the end-to-end experience: the user journey, friction points, trade-offs, and outcomes. Media leaders who adopt this mindset stop seeing campaigns as isolated efforts and start seeing them as inputs into a broader system.

In many of the industries I’ve worked in, that system is anything but simple.

Dig deeper: Why PPC teams are becoming data teams

Media doesn’t live in a vacuum

Marketing performance rarely exists in isolation. In many industries (especially those with longer decision cycles), a click is just the beginning, not the win. 

Whether you’re selling financial services, healthcare, or education, prospects move through nonlinear journeys influenced by multiple touchpoints, stakeholders, and moments of friction. This is where full-stack thinking becomes critical.

Example 1: When media isn’t the problem, the experience is

I’ve lost count of how many times I’ve heard this reaction when performance starts slipping: “The platform is getting more expensive.”

Sometimes that’s true. But a product-minded media leader asks deeper questions:

  • Has the conversion experience changed recently?
  • Did we add steps, fields, or requirements?
  • Are we driving mobile traffic to a hostile desktop experience?

Across industries, I’ve repeatedly seen strong intent at the keyword or audience level, healthy CTRs, and solid landing-page engagement followed by a steep drop-off at the point of conversion. It’s a product experience problem.

In higher ed, this often shows up when high-intent program traffic is routed to lengthy or confusing application flows, generic inquiry forms, or experiences that don’t match the promise of the ad, especially on mobile. Prospective students signal strong intent, only to hit friction that has nothing to do with media and everything to do with the experience they’re asked to navigate.

A full-stack marketer doesn’t just flag this: they bring data, partner cross-functionally, and help prioritize fixes based on impact.

Get the newsletter search marketers rely on.


Example 2: Different audiences, different ‘products’

One of the most important product principles is that not all users are the same, and they shouldn’t be treated that way.

Many organizations market to multiple audiences at once, each with different motivations, risk tolerance, and timelines. Treating them as if they’re buying the same “thing” is a fast track to average results.

A product-minded media leader understands that:

  • The value proposition changes by audience.
  • The conversion event may be different.
  • The decision timeline is almost certainly different.

I’ve seen this clearly in healthcare, where patients, caregivers, and referring providers evaluate the same organization through entirely different lenses. Financial services presents a similar challenge, with banking, investment, and insurance decisions varying dramatically by life stage and goals.

Full-stack marketers adapt media strategy accordingly, from channel mix to messaging to measurement. This is because they understand product-market fit, not just audience targeting.

Example 3: What happens after the conversion

One of the biggest blind spots in media strategy is what happens after someone converts. Product thinkers ask:

  • How quickly does someone follow up?
  • Is the first touch personalized or generic?
  • Does the message align with the promise of the ad?

I’ve seen performance improve without changing media at all, simply by improving speed-to-lead or aligning follow-up messaging with campaign intent.

Healthcare offers especially clear examples of this dynamic due to intake workflows, appointment scheduling, and care coordination, but the principle is universal: media doesn’t end at the form fill. The full-stack marketer is accountable for conversions and outcomes.

Dig deeper: What AI means for paid media, user behavior, and brand visibility

Thinking in roadmaps

Another hallmark of product management is roadmap thinking: prioritizing initiatives based on impact, effort, and sequencing. Full-stack media leaders bring this same approach to marketing:

  • Short-term wins versus long-term bets.
  • Testing frameworks instead of one-off experiments.
  • Incremental improvements to conversion paths.

In practice, this might look like:

  • Phase 1: Improve mobile application UX.
  • Phase 2: Introduce program-specific landing pages.
  • Phase 3: Layer in audience-based creative and messaging.

Instead of chasing the “next shiny channel,” full-stack marketers focus on compounding gains.

Data fluency: Asking better questions

Product managers don’t just look at metrics. They interrogate them. The same should be true for media leaders. Instead of asking, “What’s the CPA?” I’ve learned to ask:

  • “Which segments are converting efficiently, and which aren’t?”
  • “How does performance differ by device, geography, or life stage?”
  • “What signals indicate readiness vs. research?”

In higher ed, this might mean:

  • Separating brand vs. non-brand intent.
  • Looking at assisted conversions.
  • Evaluating performance by program.

Data becomes a tool for decision-making.

Collaboration is the new superpower

Full-stack marketers are inherently collaborative because they have to be. In higher ed, success often requires alignment across:

  • Admissions.
  • Enrollment marketing.
  • IT and web teams.
  • Academic leadership.
  • External partners.

Media leaders who think like product managers don’t just execute requests. They help stakeholders understand trade-offs, prioritize initiatives, and rally around shared goals. They also translate data into stories people can act on.

Dig deeper: Break down data silos: How integrated analytics reveals marketing impact

See the complete picture of your search visibility.

Track, optimize, and win in Google and AI search from one platform.

Start Free Trial
Get started with

Semrush One Logo

So, what does this mean for tomorrow’s media leaders?

The rise of the full-stack marketer doesn’t mean specialization is dead. It means seeing the entire system matters more than optimizing any single piece of it.

From my perspective, tomorrow’s strongest media leaders will:

  • Understand the business behind the campaign.
  • Think beyond their channel.
  • Advocate for the user experience.
  • Use data to inform and influence.
  • Embrace ambiguity (and occasionally chaos).

In categories where trust, timing, and transformation are at the core of the “product,” this mindset is no longer optional.

At its heart, marketing here is more than campaigns. It’s guiding life-changing choices. If you’re a media leader feeling like your role is expanding faster than your job description — congratulations! You’re not losing focus. You’re evolving.

Read more at Read More

Web Design and Development San Diego

McKinsey’s ‘Organize to Value’ a blueprint for evolving to positionless marketing by Optimove

Buying AI capabilities to drive marketing is easy. Enabling marketing teams to actually use it independently, decisively, and at scale is far harder.

The main culprit? Humans.

Marketing teams have always had the same elusive goal: to move at the pace of the consumer. Responding to each customer’s needs in real time, delivering the relevant message at the right moment, and optimizing customer lifetime value to drive loyalty and ROI. The goal is not new.

What is perpetually new are the AI technologies available to analyze consumer data and generate instant, personalized messaging at scale. But while technology evolves rapidly, the ability of marketing teams to harness it independently and decisively has not kept pace. The main obstacle is organizational: most marketing teams have not structured themselves to extract full value from the technology they already have.

This is not to say that there is no progress.  There is. Marketing teams that have crossed that chasm are seeing extraordinary results.

One case in point is Caesars Entertainment that reduced campaign execution time from five days to five minutes. Asadul Shah, vice president of player revenue Strategy, called it “a massive game changer.”

Before that transformation, Caesars marketers manually built targeting lists across disconnected systems, coordinated across multiple tools and waited on engineers, analysts and creative teams before anything could go out. The result was an operation too slow to target players with the precision and timing the market demanded.

Caesars worked with Optimove to consolidate data, orchestration and execution in one platform. Shah noted the transformation made marketing “not just more efficient; it is more responsive to what our players actually need in the moment.”

What made it work was not technology alone. Caesars implemented Positionless Marketing, a framework that frees marketing teams from fixed roles, giving every marketer the power to execute any task instantly and independently. Optimove provided the platform. Caesars built the team structure to make it real. Technology and human ingenuity working together making Positionless Marketing possible.

Any organization achieving this kind of transformation is doing what McKinsey calls “organizing to value,” a fundamental rethink of structure, decision-making and accountability that turns a marketing team into an operation built to drive value continuously. For marketing, that means becoming a Positionless team that optimizes customer lifetime value, drives loyalty and delivers measurable ROI.Below, we use McKinsey’s Organize to Value framework to outline the pitfalls that block Positionless Marketing and the blueprint to build teams that can execute any marketing task, instantly and independently.

The six pitfalls inhibiting the transition to Positionless Marketing

McKinsey has identified six core problems preventing marketing teams from successfully evolving into the Positionless model. Of these, only one is about technology. All the others are about how leaders and teams are getting in their own way.

  • Unclear objectives push teams toward activity metrics instead of outcomes. When marketing goals are vague, execution defaults to roles and handoffs rather than impact.
  • Misaligned governance creates approval layers that add days to decisions that should be faster. In marketing, excessive controls directly conflict with the speed required to deliver customer value.
  • Uncommitted leaders manage through silos rather than enabling autonomy, preventing marketing teams from evolving past role-based dependency.
  • Stagnant marketing culture resists experimentation even when the right tools are in place, slowing execution regardless of technology investment.
  • Muddled marketing execution, with unclear process ownership, leaves no single person accountable for results, and performance erodes accordingly.
  • Disconnected technology reinforces data compartmentalization and separation of tasks among sub-teams, making strategic alignment and agile responses virtually impossible.

These are the realities of assembly-line marketing operations — not Positionless ones. Insights live with analysts. Creativity lives with designers. Activation lives with engineers. Value disappears in the spaces between them.The assembly line was built for control. It was never built to deliver value.

Assembly-line marketing is counter to what Peter Drucker, the father of modern management, said: “The purpose of business is to create and keep a customer.”

How McKinsey’s Blueprint helps build positionless marketing teams (and why the effort pays off)

McKinsey’s “Organize to Value” blueprint proposes a fundamental shift: design organizations around value creation, clear outcomes, impact over job titles and minimal friction execution. It provides the foundation to become Positionless and build the conditions for marketing teams to keep customers for life.

To make Positionless Marketing a reality, marketing leaders should focus on pragmatic application and the aspects that most influence marketing execution.

  1. Start with purpose and behavior. Make explicit why actions are taken, alongside what is delivered. A shared sense of purpose allows teams to make fast decisions without waiting for approval on each one.
  2. Restructure work around outcomes and accountability. Map current processes and identify where approvals slow execution without adding value. Build cross-functional flexibility over time rather than reorganizing overnight.
  3. Leadership and processes. Establish a clear decision-to-execution flow and set explicit expectations for how fast each part of the marketing process should move. Processes should enable flow, not control.
  4. Governance, technology and talent. Effective governance ensures consistency without slowing execution. Technology and AI should unlock new value, not just automate existing processes. And talent should be deployed based on what the work requires, not what a title suggests.
  5. Empower marketers to act beyond their role. Once purpose, accountability, process and technology are aligned, marketers should be free to step across traditional job functions and execute independently as Positionless Marketers. The measure of success is not role compliance; it is value delivery.

These changes require sustained commitment. But the alternative (an assembly-line structure that was never built to deliver customer value) is far costlier than the transformation itself.

The results speak for themselves. In addition to Caesars:

  • FDJ United implemented Positionless Marketing to eliminate overlapping platforms, remove reliance on other teams wherever possible and enable continuous improvement through real-time measurement. Campaign time was slashed from six weeks to hours, with end-to-end campaigns now executed by one marketer from ideation to analysis.
  • A major retailer achieved a 16.1x increase in purchase rates while saving 300 working hours per year with the same team size. The shift to Positionless Marketing allowed the team to scale personalization and impact without adding headcount… demonstrating that the framework’s value is not just speed of execution, but the ability to do fundamentally more with what you already have.

The window to act is narrowing

The technology and AI tools are here and ever evolving. Today, AI generates infinite creative variants. Data platforms surface real-time behavioral signals. Decisioning engines coordinate across channels instantly.

But technology layered on top of an assembly-line structure creates the illusion of progress. The same handoffs happen. The same approvals add the same delays. Speed arrives at the edge; the bottleneck stays in the middle.

External pressures are accelerating. Customers expect personalization and the best experience across all channels. Competition is rising and growing more complex.

Marketing leaders who wait for transformation will find their competitors have already made it. The ones moving first are pulling ahead.

McKinsey confirms what the best marketing teams already know: the right structure and technology unleash human potential — and vice versa. Smart people trapped in the wrong system will still underperform. The best AI tools in the world won’t deliver results when constrained by the wrong organization.

McKinsey’s blueprint is pointing out the way. Positionless Marketing is the destination.

Read more at Read More

Web Design and Development San Diego

Google Ads adds AI voice-over to Performance Max video ads

Google Ads is set to enhance the viewer experience of Performance Max video ads with an innovative asset optimization feature. Leveraging advanced AI voice models, this update aims to infuse video ads with realistic voice-overs, ultimately enhancing user engagement and ad performance.

Why we care. Advertisers who don’t actively opt out by March 20, will have their video ads automatically enhanced with Google’s AI voice models, changing how their ads sound to viewers without requiring any creative production work.

How it works.

  • The feature only activates on videos that don’t already contain a voice track
  • Google’s AI selects text from advertiser-provided headlines and descriptions, then generates a realistic voice-over from that copy
  • The voice-over is layered onto the existing base video and saved as a new video asset

The catch. This is opt-out, not opt-in. The default setting means ads will be automatically eligible for voice enhancement unless advertisers proactively disable it.

Key dates. Advertisers can choose to exclude their ads from this feature until March 20th. To do so, they must opt out of the video enhancement control. After the opt-out period, all ads with video enhancement control enabled will automatically be eligible for voice-enhanced versions.

Action steps for advertisers. Advertisers can adjust their video settings by visiting their ads in Google Ads.

First seen. This update was shared by Paid Search expert Arpan Banerjee who shared the update on LinkedIn.

Read more at Read More

Google Ads API enforces daily minimum budget for Demand Gen campaigns

In Google Ads automation, everything is a signal in 2026

Google will begin enforcing a minimum daily budget for Demand Gen campaigns starting April 1, 2026.

What’s happening: The Google Ads API will require a minimum daily budget of $5 USD (or local equivalent) for all Demand Gen campaigns. The change is designed to help campaigns move through the “cold start” phase with enough spend for Google’s models to learn and optimize effectively. The update will roll out as an unversioned API change, applying across all buying paths.

Technical details:

  • In API v21 and above, campaigns set below the threshold will trigger a BUDGET_BELOW_DAILY_MINIMUM error, with additional details available in the error metadata.
  • In API v20, advertisers will receive a generic UNKNOWN error, with the specific validation failure referenced in the unpublished error code field.

The rule applies when modifying budgets, start dates, or end dates in ways that push daily spend below the $5 floor — covering both daily and flighted budgets.

Impact on existing campaigns. Current Demand Gen campaigns running below the minimum will continue serving. However, any future edits to budgets or scheduling will require compliance with the new floor.

Why we care. For advertisers and developers, this adds a new compliance layer to campaign management workflows. Systems will need updating to catch and handle the new validation errors before deployment.

The bottom line. Google is standardizing a minimum investment threshold for Demand Gen — prioritizing performance stability, while requiring advertisers to adjust budgets and automation accordingly.

Read more at Read More

The AI engine pipeline: 10 gates that decide whether you win the recommendation

The AI engine pipeline- 10 gates that decide whether you win the recommendation

AI recommendations are inconsistent for some brands and reliable for others because of cascading confidence: entity trust that accumulates or decays at every stage of an algorithmic pipeline.

Addressing that reality requires a discipline that spans the full algorithmic trinity through assistive agent optimization (AAO). It also demands three structural shifts: the funnel moves inside the agent, the push layer returns, and the web index loses its monopoly.

The mechanics behind that shift sit inside the AI engine pipeline. Here’s how it works.

The AI engine pipeline: 10 gates and a feedback loop

Every piece of digital content passes through 10 gates before it becomes an AI recommendation. I call this the AI engine pipeline, DSCRI-ARGDW, which stands for:

  • Discovered: The bot finds you exist.
  • Selected: The bot decides you’re worth fetching.
  • Crawled: The bot retrieves your content.
  • Rendered: The bot translates what it fetched into what it can read.
  • Indexed: The algorithm commits your content to memory.
  • Annotated: The algorithm classifies what your content means across dozens of dimensions.
  • Recruited: The algorithm pulls your content to use.
  • Grounded: The engine verifies your content against other sources.
  • Displayed: The engine presents you to the user.
  • Won: The engine gives you the perfect click at the zero-sum moment in AI.

After “won” comes an 11th gate that belongs to the brand, not the engine: served. What happens after the decision feeds back into the AI engine pipeline as entity confidence, making the next cycle stronger or weaker.

DSCRI is absolute. Are you creating a friction-free path for the bots?

ARGDW is relative. How do you compare to your competition? Are you creating a situation in which you’re relatively more “tasty” to the algorithms?

Cascading confidence is multiplicative

Both sides of the AI engine pipeline are sequential. Each gate feeds the next.

Content entering DSCRI through the traditional pull path passes through every gate. Content entering through structured feeds or direct data push can skip some or all of the infrastructure gates entirely, arriving at the competitive phase with minimal attenuation.

Skipped gates are a huge win, so take that option wherever and whenever you can. You “jump the queue” and start at a later stage without the degraded confidence of the previous ones. That changes the economics of the entire pipeline, and I’ll come back to why.

Why the four-step model falls short

The four-step model the SEO industry inherited from 1998 — crawl, index, rank, display — collapses five distinct infrastructure processes into “crawl and index” and five distinct competitive processes into “rank and display.”

It might feel like I’m overcomplicating this, but I’m not. Each gate has nuance that merits its standalone position. If you have empathy for the bots, algorithms, and engines, remove friction, and make the content digestible, they’ll move you through each gate cleanly and without losing speed.

Each gate is an opportunity to fail, and each point of potential failure needs a different diagnosis. The industry has been optimizing a four-room house when it lives in a 10-room building, and the rooms it never enters are the ones where the pipes leak the worst.

Most SEO advice operates at the selection, crawling, and rendering gates. Most GEO advice operates at “displayed” and “won,” which is why I’m not a fan of the term. 

Most teams aren’t yet working on annotation and recruitment, which are actually where the biggest structural advantages are created.

Your customers search everywhere. Make sure your brand shows up.

The SEO toolkit you know, plus the AI visibility data you need.

Start Free Trial
Get started with

Semrush One Logo

Three audiences you need to cater to and three acts you need to master

The AI engine pipeline has an entry condition — discovery — and nine processing gates organized in three acts of three, each with a different primary audience.

Act I: Retrieval (selection, crawling, rendering)

  • The primary audience is the bot, and the optimization objective is frictionless accessibility.

Act II: Storage (indexing, annotation, recruitment)

  • The primary audience is the algorithm, and the optimization objective is being worth remembering: verifiably relevant, confidently annotated, and worth recruiting over the competition.

Act III: Execution (grounding, display, won)

  • The primary audience is the engine and, by extension, the person using the engine, where the optimization objective is being convincing enough that the engine chooses and the person acts.

Frictionless for bots, worth remembering for algorithms, and convincing for people. Content must pass every machine gate and still persuade a human at the end.

The audiences are nested, not parallel. Content can only reach the algorithm through the bot and can only reach the person through the algorithm. You can have the most impeccable expertise and authority credentials in the world. If the bot can’t process your page cleanly, the algorithm will never see it.

This is the nested audience model: bot, then algorithm, then person. Every optimization strategy should start by identifying which audience it serves and whether the upstream audiences are already satisfied.

Discovery: The system learns you exist

Discovery is binary. Either the system has encountered your URL or it hasn’t. Fabrice Canel, principal program manager at Microsoft responsible for Bing’s crawling infrastructure, confirmed:

  • “You want to be in control of your SEO. You want to be in control of a crawler. And IndexNow, with sitemaps, enable this control.”

The entity home website, the canonical web property you control, is the primary discovery anchor. The system doesn’t just ask, “Does this URL exist?” It asks, “Does this URL belong to an entity I already trust?” Content without entity association arrives as an orphan, and orphans wait at the back of the queue.

The push layer — IndexNow, MCP, structured feeds — changes the economics of this gate entirely. A later piece in this series is dedicated to what changes when you stop waiting to be found.

Act I: The bot decides whether to fetch your content

Selection: The system decides whether your content is worth crawling

Not everything that’s discovered gets crawled. The system makes a triage decision based on countless signals, including entity authority, freshness, crawl budget, perceived value, and predicted cost.

Selection is where entity confidence first translates into a concrete pipeline advantage. The system already has an opinion about you before it crawls a single page. That opinion determines how many of your pages it bothers to look at.

Crawling: The bot arrives and fetches your content

Every technical SEO understands this gate. Server response time, robots.txt, redirect chains. Foundational, but not differentiating.

What most practitioners miss is that the bot doesn’t arrive in a vacuum. Canel confirmed that context from the referring page can be carried forward during crawling. With highly relevant links, the bot carries more context than it would from a link on an unrelated directory.

Rendering: The bot builds the page the algorithm will see

This is where everything changes and where most teams aren’t yet paying attention. The bot executes JavaScript if it chooses to, builds the Document Object Model (DOM), and produces the full rendered page. 

But here’s a question you probably haven’t considered: how much of your published content does the bot actually see after this step? If bots don’t execute your code, your content is invisible. More subtly, if they can’t parse your DOM cleanly, that content loses significant value.

Google and Bing have extended a favor for years: they render JavaScript. Most AI agent bots don’t. If your content sits behind client-side rendering, a growing proportion of the systems that matter simply never see it.

Representatives from both Google and Bing have also discussed the efforts they make to interpret messy HTML. Here’s one way to look at it: search was built on favors, and those favors aren’t being offered by the new players in AI.

Importantly, content lost at rendering can’t be recovered at any downstream gate. Every annotation, grounding decision, and display outcome depends on what survives rendering. If rendering is your weakest gate, it’s your F on the report card. Everything downstream inherits that grade.

Act II: The algorithm decides whether your content is worth remembering

This is where most brands are losing out because most optimization advice doesn’t address the next two gates. And remember, if your content fails to pass any single gate, it’s no longer in the race.

Indexing: Where HTML stops being HTML

Rendering produces the full page as the bot sees it. Indexing then transforms that DOM into something the system can store. Two things happen here that the industry often misses:

  • The system strips the navigation, header, footer, and sidebar — elements that repeat across multiple pages on your site. These aren’t stored per page. The system’s primary goal is to identify the core content. This is why I’ve talked about the importance of semantic HTML5 for years. It matters at a mechanical level: <nav>, <header>, <footer>, <aside>, <main>, and <article> tell the system where to cut. Without semantic markup, it has to guess. Gary Illyes confirmed at BrightonSEO in 2017, possibly 2018, that this was one of the hardest problems they had at the time.
  • The system chunks and converts. The core content is broken into blocks or passages of text, images with associated text, video, and audio. Each chunk is transformed into a proprietary internal format. Illyes described the result as something like a folder with subfolders, each containing a typed chunk. The page becomes a hierarchical structure of typed content blocks.

I call this conversion fidelity: how much semantic information survives the strip, chunk, convert, and store sequence. Rendering fidelity (Gate 3) measures whether the bot could consume your content. Conversion fidelity (Gate 4) measures whether the system preserved it accurately when filing it away.

Both fidelity losses are irreversible, but they fail differently. Rendering fidelity fails when JavaScript doesn’t execute or content is too difficult for the bot to parse. Conversion fidelity fails when the system can’t identify which parts of your page are core content, when your structure doesn’t chunk cleanly, or when semantic relationships between elements don’t survive the format conversion.

Something we often overlook is that even after a successful crawl, indexing isn’t guaranteed. Content that passes through crawl and render may still not be indexed.

That might sound bad enough, but here’s a distinction that should concern you: indexing and annotation are separate processes. Content may be indexed but poorly annotated — stored in the system but semantically misclassified. Non-indexed content is invisible. Misannotated content actively confuses the system about who you are, which can be worse.

Annotation: Where entity confidence is built or broken

This is the gate most of the industry has yet to address.

Think of annotations as sticky notes on the indexed “folders” created at the indexing gate. Indexing algorithms add multiple annotations to every piece of content in the index.

I identified 24 annotation dimensions I felt confident sharing with Canel. When I asked him, his response was, “Oh, there is definitely more.” 

Those 24 dimensions were organized across five annotation layers: 

  • Gatekeepers (scope classification).
  • Core identity (semantic extraction).
  • Selection filters (content categorization).
  • Confidence multipliers (reliability assessment).
  • Extraction quality (usability evaluation).

There are certainly more layers, and each layer likely includes more dimensions than I’ve mapped. Hundreds, probably thousands. This is an open model. The community is invited to map the dimensions I’ve missed.

Annotation is where the system decides the facts: 

  • What your content is about.
  • Where it fits into the wider world.
  • How useful it is.
  • Which entity it belongs to.
  • What claims it makes.
  • How those claims relate to claims from other sources. 

Credibility signals — notability, experience, expertise, authority, trust, transparency — are evaluated here. Topical authority is assessed here, too, along with much more.

Annotation operates on what survives rendering and conversion. If critical information was lost at either gate, the annotation system is working with degraded raw material. It annotates what the annotation engine received, not what you originally published.

Canel confirmed a principle I suggested that should reshape how we think about this gate: “The bot tags without judging. Filtering happens at query time.” Annotation quality determines your eligibility for every downstream triage.

I have a full piece coming on annotation alone. For now, annotation is the gate where most brands silently lose and the one most worth working on.

Recruitment: Where the algorithmic trinity decides whether to absorb you

This is the first explicitly competitive gate. After annotation, the pipeline feeds into three systems simultaneously. 

  • Search engines recruit content for results pages (the document graph). 
  • Knowledge graphs recruit structured facts for entity representation (the entity graph). 
  • Large language models recruit patterns for training data and grounding retrieval (the concept graph).

Before recruitment, the system found, crawled, stored, and classified your content. At recruitment, it decides whether your content is worth keeping over alternatives that serve the same purpose.

Being recruited by all three elements of the algorithmic trinity gives you a disproportionate advantage at grounding because the grounding system can find you through multiple retrieval paths, and at display because there are multiple opportunities for visibility.

Recruitment is the structural advantage that separates brands with consistent AI visibility from brands that appear inconsistently.

Get the newsletter search marketers rely on.


Act III: The engine presents and the decision-maker commits

Grounding: Where AI checks its confidence in the content against real-time evidence

This is the gate that separates traditional search from AI recommendations.

Ihab Rizk, who works on Microsoft’s Clarity platform, described the grounding lifecycle this way:

  • The user asks a question. 
  • The LLM checks its internal confidence. If it’s insufficient, it sends cascading queries, multiple angles of intent designed to triangulate the answer, which many people call fan-out queries. 
  • Bots are dispatched to scrape selected pages in real time. 
  • The answer is generated from a combination of training data and fresh retrieval.

But grounding isn’t just search results, as many people believe. The other two technologies in the algorithmic trinity play a role.

The knowledge graph is used to ground facts. AI Overviews explicitly showed information grounded in the knowledge graph. It’s reasonable to assume specialized small language models are used to ground user-facing large language models.

The takeaway is that your content’s performance from discovery through recruitment determines whether your pages are in the candidate pool when grounding begins. If your content isn’t indexed, isn’t well annotated, or isn’t associated with a high-confidence entity, it won’t be in the retrieval set for any part of the trinity. The engine will ground its answer on someone else’s content instead.

You can’t optimize for grounding if your content never reaches the grounding stage.

Display: The output of the pipeline

Display is where most AI tracking tools operate. They measure what AI says about you. But by the time you’re measuring display, the decisions were already made upstream, from discovery through grounding.

Brands with high cascading confidence appear consistently. Brands with low cascading confidence appear intermittently, the same phenomenon Rand Fishkin demonstrated.

Display is where AI meets the user. It also covers the acquisition funnel, which is easy to understand and meaningful for marketers. This is where most businesses focus because it’s visible and sits just before the click. I’ll write a full article on that later in this series.

Won: The moment the decision-maker commits

Won is the terminal processing gate in the AI engine pipeline. Ten gates of processing, three acts of audience satisfaction, and it comes down to this: Did the system trust you enough to commit?

The accumulated confidence at this gate is called “won probability,” the system’s calculated likelihood that committing to you is the right decision. Three resolutions are possible, and they form a spectrum. To understand why that spectrum matters, you need to understand the 95/5 rule.

Professor John Dawes at the Ehrenberg-Bass Institute demonstrated that at any given moment, only about 5% of potential buyers are actively in-market. The other 95% aren’t ready to purchase. You sell to the 5%, but the real job of marketing is staying top of mind for the other 95% so that when they decide to move to purchase, on their schedule, not yours, you’re the brand they think of.

The three scenarios that follow show how AI takes over the job of being top of mind at the critical moment for the 95%. I call this top of algorithmic mind.

  • The imperfect click: The person browses a list of options, pogo-sticks between results, and decides. Traditional search and what Google called the zero moment of truth. The system doesn’t know who is ready. It shows everyone the same list and hopes. The 95/5 efficiency is low. You’re hitting and hoping, and so is the engine.
  • The perfect click: The AI recommends one solution and the person takes it. I call this the zero-sum moment in AI. This is where we are right now with assistive engines like ChatGPT, Perplexity, and AI Mode. The system has filtered for intent, context, and readiness. It presents one answer to a person moving from the 95% into the 5% with much higher precision.
  • The agential click: The agent commits, either after pausing for human approval, “Shall I book this?” or autonomously. The agent caught the moment of readiness, did the work, and closed it. Maximum precision. This is the ultimate solution to the 95/5 problem: AI catches the exact moment and acts.
The Won Spectrum

Search won’t disappear. Most people will always want to browse some of the time. Window shopping is fun, and emotionally charged decisions aren’t something people will always delegate.

The trajectory, however, moves from imperfect to perfect to agential. Brands need to optimize for all three outcomes on that spectrum, starting now. Optimizing for agents should already be part of your strategy, as should optimizing for assistive engines and search engines. AAO covers them all.

Search engines, AI assistive engines, and assistive agents are your untrained salesforce. Your job is to train them well enough that you’re top of algorithmic mind at the moment the 95% become the 5%, and the AI either:

  • Offers you as an option.
  • Recommends you as the best solution.
  • Actively makes the conversion for you.

Dig deeper: SEO in the age of AI: Becoming the trusted answer

Served: The pipeline remembers

After conversion, the brand takes over. You should optimize the post-won feedback gate. The processing pipeline, the DSCRI-ARGDW spine, gets you to the decision. Served sits outside that spine as the gate that closes the loop, turning the line into a circle.

Every “won” that produces a positive outcome strengthens the next cycle’s cascading confidence. Every “won” that produces a negative outcome weakens it. Ten gates get you to the decision. The 11th, served, determines whether the decision repeats and your advantage compounds.

This is where the business lives. Acquisition without retention is a leak, both directly and indirectly through the AI engine pipeline feedback loop.

Brands that engineer their post-won experience to generate positive evidence, reviews, repeat engagement, low return rates, and completion signals, build a flywheel. Brands that neglect post-won burn confidence with every cycle.

Diagnosing failure in the pipeline

The three acts — bot, algorithm, engine, or person — describe who you’re speaking to. The two phases describe what kind of test you’re taking.

  • Phase 1: Infrastructure, discovery through indexing
    • Absolute tests. You either pass or fail. A page that can’t be rendered doesn’t get partially indexed. Infrastructure gates are binary: pass or stall.
  • Phase 2: Competitive, annotation through won
    • Relative tests. Winning depends not just on how good your content is but on how good the competition is at the same gate.

The practical implication is infrastructure first, competitive second. If your content isn’t being found, rendered, or indexed correctly, fixing annotation quality is wasted effort. You’re decorating a room the building inspector hasn’t cleared.

In practice, brands tend to fail in three predictable ways.

  • Opportunity cost (Act I: Bot failures)
    • Your content isn’t in the system, so you have zero opportunity. Cheapest to fix, most expensive to ignore.
  • Competitive loss (Act II: Algorithm failures) 
    • Your content is in the system, but competitors’ content is preferred. The brand believes it’s doing everything right while AI systems consistently choose a competitor at recruitment, grounding, and display.
  • Conversion leak (Act III: Engine failures)
    • Your content is presented, but the system hedges or fumbles the recommendation. In short, you lose the sale.
The AI engine pipeline - DSCRI-ARGDW-Sv

Every gate you pass still costs you signal

In 2019, I published How Google Universal Search Ranking Works: Darwinism in Search, based on a direct explanation from Google’s Illyes about how Google calculates ranking bids by multiplying individual factor scores. A zero on any factor kills the entire bid.

Darwin’s natural selection works the same way: fitness is the product across all dimensions, and a single zero kills the organism. Brent D. Payne made this analogy: “Better to be a straight C student than three As and an F.” 

As with Google’s bidding system, cascading confidence is multiplicative, not additive. Here’s what that means:

Per-gate confidence Surviving signal at the won gate
90% 34.9%
80% 10.7%
70% 2.8%
60% 0.6%
50% 0.1%

Illustrative math, not a measurement. The principle is what matters: strengths don’t compensate for weaknesses in a multiplicative chain.

A single weak gate destroys everything. Nine gates at 90% plus one at 50% drops you from 34.9% to 19.4%. If that gate drops to 10%, it kills the surviving signal entirely. A near-zero anywhere in a multiplicative chain makes the whole chain near-zero.

This is competitive math. If your competitors are all at 50% per gate and you’re at 60%, you win: 0.6% surviving signal against their 0.1%. Not because you’re excellent, but because you’re less bad. 

Most brands aren’t at 90%. The worse your gates are, the bigger the gap a small improvement opens. Here’s an example.

Gate D S C R I A Re G Di W Surviving Signal
Discovered Selected Crawled Rendered Indexed Annotated Recruited Grounded Displayed Won
Your Brand 75% 80% 70% 85% 75% 5% 80% 70% 75% 80% 0.4%
Competitor 65% 60% 65% 70% 60% 60% 65% 60% 65% 60% 1.8%

I chose annotated as the “F” grade in this example for demonstrative purposes.

Annotation is the phase-boundary gate. It’s the hinge of the whole pipeline. If the system doesn’t understand what your content is, nothing downstream matters.

Applying this Darwinian principle across a 10-gate pipeline, where confidence is measurable at every transition, is my diagnostic model. I recently filed a patent for the mechanical implementation.

Improving gates versus skipping them

There are two ways to increase your surviving signal through the pipeline, and they aren’t equal.

Improving your gates

Better rendering, cleaner markup, faster servers, and schema help the system classify your content more accurately. These are real gains, single-digit to low double-digit percentage improvements in surviving signal.

For many brands and SEOs, this is maintenance rather than transformation. It matters, and most brands aren’t doing it well, but it’s incremental.

Skipping gates entirely

Structured feeds, Google Merchant Center and OpenAI Product Feed Specification, bypass discovery, selection, crawling, and rendering altogether, delivering your content to the competitive phase with minimal attenuation. 

MCP connections skip even further, making data available from recruitment onward with triple-digit percentage advantages over the pull path.

If you’re only improving gates, you’re leaving an order of magnitude on the table.

The highest-value target is always the weakest gate

Improving your best gate from 95% to 98% is nearly invisible in the pipeline math. Improving your worst gate from 50% to 80% transforms your entire surviving signal. That’s the Darwinian principle at work: fitness is multiplicative, the weakest dimension determines the outcome, and strengths elsewhere can’t compensate.

Most teams are optimizing the wrong gate. Technical SEO, content marketing, and GEO each address different gates. Each is necessary, but none is sufficient because the pipeline requires all 10 to perform. Teams pouring budget into the two or three gates they understand are ignoring the ones that are actually killing their signal.

Then there’s the single-system mistake. At recruitment, the pipeline feeds into three graphs, the algorithmic trinity. Missing one graph means one entire retrieval path doesn’t include you.

You can be perfectly optimized for search engine recruitment and completely absent from the knowledge graph and the LLM training corpus. In a multiplicative system, that gap compounds with every cycle.

Most of the AI tracking industry is measuring outputs without diagnosing inputs, tracking what AI says about you at display when the decisions were already made upstream. That’s like checking your blood pressure without diagnosing the underlying condition.

The tools to do this properly are emerging. Authoritas, for example, can inspect the network requests behind ChatGPT to understand which content is actually formulating answers. But the real work is at the gates upstream of display, where your content either passed or stalled before the engine ever opened its mouth.

See the complete picture of your search visibility.

Track, optimize, and win in Google and AI search from one platform.

Start Free Trial
Get started with

Semrush One Logo

Audit your pipeline: Earliest failure first

The correct audit order is pipeline order. Start at discovery and work forward.

If content isn’t being discovered, nothing downstream matters. If it’s discovered but not selected for crawling, rendering fixes are wasted effort. If it’s crawled but renders poorly, every annotation and grounding decision downstream inherits that degradation.

This is your new plan: Find the weakest gate. Fix it. Repeat.

The inconsistency Fishkin documented is a training deficit. The AI engine pipeline is trainable. The training compounds. The walled gardens increase their lock-in with every cycle.

The brand that trains its AI salesforce better than the competition doesn’t just win the next recommendation. It makes the next one easier to win, and the one after that, until the gap widens to the point where competitors can’t close it without starting from scratch.

Without entity understanding, nothing else in this pipeline works. The system needs to know who you are before it can evaluate what you publish. Get that right, build from the brand up through the funnel, and the compounding does the rest.

Next: The five infrastructure gates the industry compressed into ‘crawl and index’

The next piece opens the infrastructure gates in full: rendering fidelity, conversion fidelity, JavaScript as a favor, not a standard, structured data as the native language of the infrastructure phase, and the investment comparison that puts numbers on improving gates versus skipping them entirely. 

The sequential audit shows where your content is dying before the algorithm ever sees it, and once you see the leaks, you can start plugging them in the order that moves your surviving signal the most.

This is the third piece in my AI authority series. The first, “Rand Fishkin proved AI recommendations are inconsistent – here’s why and how to fix it,” introduced cascading confidence. The second, “AAO: Why assistive agent optimization is the next evolution of SEO” named the discipline. 

Read more at Read More