Increased usage of AI is changing how people discover businesses and services online. While your website may be optimized for traditional search engines, large language models (LLMs) process your website’s information differently. Our new feature, llms.txt offers to bridge the gap. Yoast SEO generates a file that highlights the most important, up-to-date content on your website as an invitation for LLMs to get the right picture. It’s automatic, requires no technical setup, and is ready in one click.
Helping AI understand your website
Unlike search engines that regularly crawl and index websites, LLMs like ChatGPT and Google Gemini work differently. They don’t store website content for future use. Instead, they gather information in real time when responding to user queries.
This means LLMs often only access a small portion of a website while looking for answers. This is especially true for large websites such as news platforms or ecommerce stores. This can lead to incomplete or even inaccurate AI-generated responses. Not ideal if you’re aiming to improve your visibility in LLM-generated answers as part of your marketing strategy.
The llms.txt file gives LLMs a suggested, pre-prepared slice of your website, highlighting your most important and up-to-date content.
Think of it like a helpful guide at the entrance of a large department store. Imagine you’re walking in looking for socks. Someone greets you and hands you a store map that highlights where the socks are, along with other key departments like shoes, checkout, and customer service. You don’t have to use the map, you can wander around on your own, but it makes it much easier to quickly find what you’re looking for.
In the same way, this file helps LLMs quickly identify the most relevant and useful parts of your website. While the models can still explore other areas, giving them clear guidance increases the chances that they’ll surface the right information in their responses.
How is it different from robots.txt?
robots.txt
Tells bots what not to access
Focuses on permission
Used for search engine indexing and crawling
Supported by traditional search engines
llms.txt
Suggests what AI should read
Focuses on guidance and clarity
Helps AI answer user questions more accurately
Designed for large language models like ChatGPT
How does Yoast SEO llms.txt work?
When you turn the feature on, it automatically generates an llms.txt file for your website, using a mix of relevant website data. It draws from:
Your most recently updated content
Technical SEO elements like your sitemap for context
Descriptions you’ve added about your website
This offers large language models a website summary to understand what your website is about and what content is most important.
Managing your llms.txt file
The plugin automatically creates and maintains the llms.txt file for you, refreshing every week. You can preview the file to ensure it accurately reflects your brand and prioritizes the right content before implementation.
Want full control or prefer to manage it yourself? Learn how to manually add an llms.txt file to your website by visiting our developer documentation.
At Yoast, our mission is SEO for everyone
Setting up an llms.txt file manually may only be accessible to a technical few. By automating the process, we make it easier for all website owners to benefit from this new technology, without needing to dive into code.
At Yoast, we believe that everyone should have a say in how their content is seen and used. Especially as AI plays a bigger role in how people discover information online. That’s why we’ve introduced this feature as opt-in, so you can decide if and when it makes sense for your website. We’ve seen early signs that this is something more website owners are starting to think about.
Just as robots.txt tries to help search engines understand what to index, llms.txt suggests which parts of your website large language models should pay attention to.If you’d like to see what an llms.txt file looks like in practice, you can view the live version on yoast.com.
http://dubadosolutions.com/wp-content/uploads/2017/05/dubado-logo-1.png00http://dubadosolutions.com/wp-content/uploads/2017/05/dubado-logo-1.png2025-06-10 08:21:532025-06-10 08:21:53New: Future proof your website for tomorrow’s visitors with Yoast SEO llms.txt
You type a few keywords into Amazon. A brand called Truly Beauty pops up. You’ve never heard of them.
So you go to YouTube to find the “best after shave oil”.
At the top of the results, someone has reviewed Truly Beauty’s product.
Okay, interesting…
Let’s stay on YouTube. Next, you type “truly beauty after shave oil” into the search.
What the? The whole page has people reviewing Truly Beauty products!
Is this brand legitimate, or are all these ads in disguise?
Time to go to Reddit to get some unfiltered opinions.
You search for “after shave oil reviews reddit” and notice that once again, Truly Beauty shows up in the results.
Sure enough, other people share your skepticism. But there’s some positive feedback too.
You decide to give them a try.
This kind of journey happens millions of times every day — across every industry, on every platform.
Side note: I run a men’s apparel brand, but I often research women’s beauty. It’s insanely competitive and usually way ahead in digital strategy.
If you’re in SEO, there’s a clear takeaway here:
You’re not just optimizing for Google anymore.
You need to show up across the entire decision-making journey. Wherever your audience searches, scrolls, or compares.
This is exactly what Truly Beauty figured out.
They didn’t just optimize for Google. They built visibility across the entire search ecosystem. Amazon for discovery. YouTube for social proof. Reddit for authentic reviews.
And it’s working amazingly well.
In this guide, I’ll break down how to optimize your brand for how people actually search today. With concrete examples. Including Truly Beauty’s strategy.
Free resource: To make things easier, I’ve created a checklist to track your progress
Let’s start with what’s really happening here.
The New Reality: Search Everywhere Optimization
What Truly Beauty did isn’t luck. It’s strategy.
They understood something most brands still miss:
Search has changed.
Today’s customers don’t follow a clean, Google-only path. They bounce from TikTok to YouTube, Reddit to Amazon, back to Google, then maybe ChatGPT for one last check.
Credit where it’s due: Rand Fishkin captured this evolution perfectly in his recent post.
Search Everywhere Optimization is about helping people find, evaluate, and trust your brand across every platform where discovery happens. That includes Google — but also YouTube, TikTok, Reddit, Amazon, LinkedIn, and even AI tools like ChatGPT.
Every one of those platforms can shape a decision. Miss one? You risk losing the customer to someone who showed up where you didn’t.
Your job isn’t just to rank on Google.
It’s to help people find, evaluate, and trust your brand everywhere they search.
Some call this omnichannel SEO, cross-platform optimization, AEO (Answer Engine Optimization), or GEO (Generative Engine Optimization).
The way I see it:
Search Everywhere Optimization.
Because the search journey now includes everything from YouTube Shorts to AI summaries.
And your job is to build visibility, credibility, and conversion power across it all.
It’s not just about being found.
It’s about being trusted. On every platform where decisions happen.
That’s what makes Search Everywhere Optimization different — it evolves SEO beyond a siloed tactic into a full-funnel growth strategy.
So, you’re not just optimizing pages anymore.
You’re shaping how people find, evaluate, and trust what you offer across every stage of the journey, on every platform they turn to for answers.
Show up on high-engagement platforms where decisions start
Create content that resonates in the right format and context
Build trust through experience — design, messaging, and credibility
Turn search moments into conversions, leads, or long-term users
That’s the shift:
From rankings to relevance. From clicks to action. From Google-only to everywhere that matters.
Two Core Areas of Search Everywhere Optimization
To make Search Everywhere Optimization work, you need to understand where your audience is discovering products.
And how much control you have over those moments.
That’s where this framework comes in.
We divide the modern search experience into two key areas:
Managed experiences — where you control the content and presentation
Influenced experiences — where others shape the narrative, but your brand still shows up
This distinction helps you prioritize efforts across platforms you own… and platforms where you earn visibility.
Managed Experiences
These are touchpoints you can directly control.
Your website is still your most important owned asset. But you also manage your social media profiles, product listings, app store pages, and more.
This is where things gets tactical. You’re shaping the journey with:
Engaging content
Clear messaging
Cohesive visuals
Optimized flows and CTAs
On your website, you can go even deeper — refining structure, page speed, copy, and trust signals.
The goal? Deliver a fast, credible, and conversion-ready experience every time someone finds you through search.
Earned and Influenced Experiences
Now, let’s talk about where you don’t control the narrative.
These are the moments shaped by others: customers, creators, communities, algorithms.
Earned and influenced experiences are touchpoints you don’t directly control.
But they still shape how people perceive and trust your brand.
This includes:
Customer reviews
Reddit threads
YouTube mentions
Third-party comparisons
AI-generated responses in tools like ChatGPT
You can’t control these spaces… but you can influence them.
Search Everywhere Optimization is about increasing your visibility, credibility, and perceived value in places you don’t own.
That might mean:
Engaging in relevant conversations
Encouraging customer reviews
Partnering with trusted voices
Publishing helpful content that others cite
Truly Beauty does this well. Their TikTok is a managed asset. The brand controls the content, caption, and messaging.
This isn’t about control. It’s more about visibility, relevance, and credibility in places people already go to decide.
Luckily, you can help shape perception through helpful content, real engagement, and clear value.
You can pay influencers to review and interact with your product, publish high-quality guest posts. So, you don’t have full control over them, but you can light the fire.
For example, Truly Beauty has a strong presence across owned and earned/influenced platforms.
This includes the brand’s official TikTok account, an owned experience.
The brand controls the content, caption, and messaging.
But when someone searches for Truly on TikTok and sees unsponsored reviews? That’s an influenced experience.
Both matter. Because both shape how people perceive your brand.
Search Everywhere Optimization ensures you show up in both worlds (managed and influenced) so you’re part of the journey no matter where it happens.
How Search Everywhere Optimization Builds on Traditional SEO
Traditional SEO has mostly focused on one thing — ranking on search engines like Google.
That still matters.
But it’s no longer enough.
Search Everywhere Optimization expands your SEO strategy beyond Google to include every platform where people search, compare, and decide.
So instead of optimizing just for rankings…
You’re optimizing the entire discovery journey.
This shift doesn’t replace SEO. It levels it up.
Here’s how they work together:
Traditional
SEO
Search Everywhere Optimization
Primary Goal
Drive qualified traffic from Google and other search engines
Help people find, evaluate, and take action across platforms
Tactics
Focus on content, keywords, backlinks, and technical fixes
Tailor messaging and format to each platform and stage of the journey
Performance Metrics
Metrics include rankings, impressions, CTR, and conversions
Metrics include engagement, watch time, scroll depth, reviews, and cross-platform performance
Think of it this way:
Traditional SEO gets you found on Google
Search Everywhere Optimization gets you chosen — everywhere
When you combine both, you create a strategy that moves with your audience.
Across platforms. Across formats. Across every step of their journey.
Step 1: Define Your Search Personas
Creating search personas lets you outline what your ideal audience wants and needs, and what drives their decisions.
This helps you design content and experiences based on real search behavior, rather than assumptions.
Pro tip: Already have marketing personas? Add a “Search Behavior” section to show how your audience searches, discovers, and evaluates solutions online.
Start with Real People
Before you can build your personas, you need real-world insights.
Go straight to the source by asking existing customers questions like:
How they found you
What made them trust you
What they needed before taking action
Tools like Typeform let you create and distribute surveys.
Start with their ready-to-use consumer behavior templates to make the process fast and easy.
Loop in Sales and Support
No one knows buyer questions better than your frontline team.
Ask them:
What keywords or phrases do people use when they reach out?
Which platforms drive user discovery?
What’s unclear or confusing before people convert?
This input gives you practical insights you can’t get from keyword tools alone.
Layer in Data
Tools like Semrush’s Traffic & Market Toolkit let you analyze your target market’s demographics.
Here’s how it works:
Enter your domain and up to four competitors’ domains.
Click “Analyze.”
View the “Audience” report to get a breakdown of unique visitors to each domain by age and sex.
Then, scroll to the “Geo Distribution” report to see an overview of visits and unique visitors by country.
Next, click “Audience Overlap” to learn about your audience’s online habits.
Including their most-visited domains. This gives you insights into their preferences, pain points, and needs.
Once you’ve gathered your data, organize everything into a clean visual persona.
Or just use a doc or spreadsheet — whatever helps you capture the key insights clearly.
By the end, you should know:
What your audience is trying to solve when they search
What blocks or gaps slow them down
What type of content or format resonates most
These insights give you a clear picture of who your searchers are and what matters to them.
Note: You can create multiple personas if your product serves more than one audience. For example, a beginner and a power user won’t search the same way or want the same content.
Step 2: Map the Full Search Journey
Map how each search persona moves from discovery to decision across platforms, questions, and content types.
We want to start by breaking the journey into three simple stages.
Quick note:
I’m showing these stages as a linear progression for simplicity. Real search journeys usually aren’t straightforward.
Users frequently jump between platforms and stages, circling back and moving forward unpredictably. This framework simply helps organize our understanding of the core phases searchers experience.
Discover: This is when someone first realizes a need or problem and starts looking for ideas, inspiration, or possible solutions
Compare: At this stage, they evaluate their options, which involves comparing features, reading reviews, or checking alternatives to decide what fits best
Act: This is when they’re ready to take action. Including making a purchase, signing up, booking a service, or taking the next step.
Expand this journey into more stages and variations as needed.
Like awareness, consideration, evaluation, or post-purchase.
For simplicity, we’ll stick with three core stages.
Then, for each stage, identify:
What they search for
Where they go to find answers
What content format they expect
Let’s say we’re mapping the search journey of a shopper discovering Truly Beauty.
A user might first come across this brand when searching for “best after shave oil” on TikTok.
From there, they Google “after shave oil” and see Truly in the top results.
Next, they visit the brand’s site to view product details, images, and pricing.
After that, they head to YouTube.
They search “truly after shave oil review” to find reviews from real people.
Finally, they visit Amazon, search for the product, and check reviews again before placing their order.
This is a simplified version of your audience’s actual journey.
In reality, searchers might visit more platforms during the discovery and compare stages — spanning days or even weeks.
This is why it helps to map the complete journey.
Like this:
Have more than one persona or product category? Create a separate map for each.
Many platforms offer free customer journey map templates, such as Canva and Miro.
Step 3: Identify Gaps and Prioritize Touchpoints
Here’s where you’ll identify what your brand is missing across the search journey and what to fix first.
Using your journey map from Step 2, go through each stage and ask:
Are we visible everywhere our audience searches?
Does our content actually help them move forward?
Let me walk you through an example.
I conducted a quick manual audit for Truly Beauty across multiple platforms.
On TikTok and Instagram, they consistently appear for branded searches like “Truly Beauty.”
And product-specific searches like “vanilla baby body oil.”
Next, I examined user-generated forums to see if people discuss the brand organically.
On Reddit, I found some positive threads where users recommend Truly products.
And some negative threads, too.
Overall, Truly Beauty could have a stronger presence in earned and influenced spaces.
Ever feel frustrated having to jump between different apps just to check your site’s SEO performance? We’ve simplified things for you. Yoast now seamlessly integrates insights from Site Kit by Google (Google Analytics and Search Console) right into your Yoast Dashboard, giving you one clear view to manage your website’s SEO effectively.
Here’s why you’ll love this:
Connect once, get instant clarity: Easily link your Yoast Dashboard and Site Kit by Google just once, avoiding multiple logins and complex workflows.
Instantly see where to focus your efforts: Efficiently recognize your best opportunities to boost visibility and rankings, allowing you to prioritize SEO tasks effectively.
Stay effortlessly informed: The Yoast Dashboard integration with Site Kit by Google connects your analytics and search data seamlessly in one place, so you can quickly see important metrics like organic traffic, impressions, clicks, and bounce rates without switching tabs.
How to connect your Site Kit by Google to the Yoast SEO Dashboard
Update your Yoast plugin to the latest version.
Go to your Yoast Dashboard in WordPress.
Follow the steps in the Site Kit installation widget.
Start reviewing insights directly in your Yoast Dashboard.
Connect Site Kit by Google to your Yoast Dashboard today and simplify your SEO workflow!
Disclaimer!
Please note that we’re rolling out this new feature in phases. This means that you might not see the Site Kit integration in your Yoast Dashboard yet. Eventually, this integration will be available to everyone, so stay tuned!
http://dubadosolutions.com/wp-content/uploads/2017/05/dubado-logo-1.png00http://dubadosolutions.com/wp-content/uploads/2017/05/dubado-logo-1.png2025-06-03 10:54:002025-06-03 10:54:00Site Kit by Google insights in your Yoast SEO Dashboard
We’re excited to announce that Yoast AI Optimize is now also available when using the Classic Editor in WordPress!
You’ve finished your copy, great! But those pesky Yoast SEO Analysis lights aren’t all green and you have to make manual changes. That’s where Yoast AI Optimize comes in. With Yoast SEO Premium, you can now get AI-powered suggestions right inside your Classic Editor to help fine-tune your content.
What is Yoast AI Optimize?
Yoast AI Optimize brings smart, targeted SEO support into your writing flow. It gives AI-powered suggestions for specific assessments in the Yoast SEO analysis, such as length, structure, and keyphrase distribution. You’ll see exactly where improvements can be made and get quick, editable suggestions to help you fix them. You can quickly apply or dismiss them; the final decision always remains yours.
Benefits:
Get real-time AI suggestions that help improve SEO and readability
Edit suggestions to match your style and tone of voice
Apply or dismiss suggestions easily without breaking your writing flow
Use it in both the Classic and Block editors with Yoast SEO Premium
Supports optimization for:
Keyphrase in introduction
Keyphrase distribution
Keyphrase density
Sentence length
Paragraph length
Whether you’re using the Classic Editor or sticking with the Block Editor, Yoast AI Optimize helps you improve your SEO score faster, without losing the personal touch.
If you’re curious to know how we built this feature, check out our developer blog post with all the behind the scenes.
Ready to optimize smarter? Update to Yoast SEO Premium to try AI Optimize in the Classic Editor today!
http://dubadosolutions.com/wp-content/uploads/2017/05/dubado-logo-1.png00http://dubadosolutions.com/wp-content/uploads/2017/05/dubado-logo-1.png2025-06-02 14:32:452025-06-02 14:32:45Yoast AI Optimize is now available for Classic Editor