AI search engines and chatbots often provide wrong answers and make up article citations, according to a new study from Columbia Journalism Review.
Why we care. AI search tools have ramped up the scraping of your content so they can serve answers to their users, often resulting in no clicks to your website. Also, click-through rates from AI search and chatbots are much lower than Google Search, according to a separate, unrelated study. But hallucinating citations makes an already bad situation even worse.
By the numbers. More than half of the responses from Gemini and Grok 3 cited fabricated or broken URLs that led to error pages. Also, according to the study:
Overall, chatbots provided incorrect answers to more than 60% of queries:
Grok 3 (the highest error rate) answered 94% of the queries incorrectly.
Gemini only provided a completely correct response on one occasion (in 10 attempts).
Perplexity, which had the lowest error rate, answered 37% of queries incorrectly.
What they’re saying. The study authors (Klaudia Jaźwińska and Aisvarya Chandrasekar), who also noted that “multiple chatbots seemed to bypass Robot Exclusion Protocol preferences,” summed up this way:
“The findings of this study align closely with those outlined in our previous ChatGPT study, published in November 2024, which revealed consistent patterns across chabots: confident presentations of incorrect information, misleading attributions to syndicated content, and inconsistent information retrieval practices. Critics of generative search like Chirag Shah and Emily M. Bender have raised substantive concerns about using large language models for search, noting that they ‘take away transparency and user agency, further amplify the problems associated with bias in [information access] systems, and often provide ungrounded and/or toxic answers that may go unchecked by a typical user.’”
About the comparison. This analysis of 1,600 queries compared the ability of generative AI tools (ChatGPT search, Perplexity, Perplexity Pro, DeepSeek search, Microsoft CoPilot, xAI’s Grok-2 and Grok-3 search, and Google Gemini) to identify an article’s headline, original publisher, publication date, and URL, based on direct excerpts of 10 articles chosen at random from 20 publishers.
https://i0.wp.com/dubadosolutions.com/wp-content/uploads/2025/03/sad-robot-on-phone-1920-800x457-Bte36n.jpeg?fit=800%2C457&ssl=1457800http://dubadosolutions.com/wp-content/uploads/2017/05/dubado-logo-1.png2025-03-11 19:04:222025-03-11 19:04:22AI search engines often make up citations and answers: Study
AI-powered search engines (e.g., OpenAI’s ChatGPT, Perplexity) are failing to drive meaningful traffic to publishers while their web scraping activities increase. That’s one big takeaway from a recent report from TollBit, a platform that says it helps publishers monetize their content.
CTR comparison. Google’s average search click-through rate (CTR) was 8.63%, according to the report. However, the CTR for AI search engines was 0.74% and 0.33% CTR for AI chatbots. That means AI search sends 91% fewer referrals and chatbots send 96% less than traditional search.
Why we care. This is bad news for publishers because it shows AI search won’t replace traditional search traffic. As AI-generated answers replace direct website visits, you should expect to see this trend continue.
By the numbers. AI bot scraping doubled (+117%) between Q3 and Q4 2024. Also:
The average number of scrapes from AI bots per website for Q4 was 2 million, with another 1.89 million done by hidden AI scrapers.
40% more AI bots ignored robots.txt in Q4 than in Q3.
ChatGPT-User bot activity skyrocketed by 6,767.60%, making it the most aggressive scraper.
Top AI bots by share of scraping activity:
ChatGPT-User (15.6%)
Bytespider (ByteDance/TikTok) (12.44%)
Meta-ExternalAgent (11.34%)
PerplexityBot continued sending referrals to sites that had explicitly blocked it, raising concerns about undisclosed scraping.
Context. One company, Chegg, is attempting to sue Google over AI Overviews. Chegg claims Google’s search feature has severely damaged its traffic and revenue.
Google announced last week an expansion of AI Overviews. It is now starting to show AI Overviews to users who aren’t logged in.
About the data. There’s no methodology section, so it’s not entirely clear how many websites were analyzed, just that it’s based on “all onboarded ToolBit sites in Q4.” Toolbit says it “helps over 500 publisher sites.”
https://i0.wp.com/dubadosolutions.com/wp-content/uploads/2025/03/ai-search-crawlers-agents-bots-800x450-wyjgHD.png?fit=800%2C450&ssl=1450800http://dubadosolutions.com/wp-content/uploads/2017/05/dubado-logo-1.png2025-03-11 16:52:232025-03-11 16:52:23As AI scraping surges, AI search traffic fails to follow: Report
Google Ads is significantly increasing the negative keyword limit for Performance Max (PMax) campaigns, raising the cap from 100 to 10,000 per campaign, aligning with Search campaigns.
By the numbers:
Previous cap: 100 negative keywords per PMax campaign
New cap: 10,000 negative keywords per PMax campaign
Rollout timeline: Next few weeks for all PMax advertisers
Why we care. Advertisers had expressed frustration that the previous 100-keyword limit was too restrictive, limiting control over where their ads appeared. The update provides greater flexibility while maintaining campaign effectiveness.
The big picture: Google Ads Liaison, Ginny Marvin says the cap ensures system flexibility while giving advertisers more control, in her update on X. She also advises using negative keywords carefully to avoid limiting conversions.
What’s next: Google is working on further enhancements, including support for negative keyword lists in PMax later this year. Advertisers can also use tools like brand exclusions and account-level negative keywords for additional control.
Google is adding more engagement options to Performance Max campaigns, adding Message assets alongside those already available in Search campaigns.
What’s new:
The Message assets functionality, previously exclusive to Search ads, was spotted by digital marketer Emirhan Bayutmuş and is now available in Performance Max campaigns.
This feature allows users to initiate conversations with businesses directly from ads, enhancing engagement.
Why we care. The expansion gives advertisers another way to connect with potential customers directly through chat-based interactions, potentially improving conversion rates.
What to watch. Expect further integration of conversational ad formats as Google continues to refine its AI-driven ad experiences.
https://i0.wp.com/dubadosolutions.com/wp-content/uploads/2025/03/1741330609288-olHLZZ.jpeg?fit=800%2C968&ssl=1968800http://dubadosolutions.com/wp-content/uploads/2017/05/dubado-logo-1.png2025-03-11 15:12:182025-03-11 15:12:18Google expands Message asset to Performance Max
Despite being a popular talking point, people aren’t (yet?) abandoning Google Search and using ChatGPT search or other AI chatbots.
In fact, the number of Google searches increased year over year, and Google Search handles 373 times more searches than ChatGPT, according to a new analysis by SparkToro co-founder Rand Fishkin.
Why we care. Many search marketers, users, and analysts have speculated that AI tools are reducing Google’s dominance in search. However, this research finds no evidence that vast numbers of searchers are abandoning Google for ChatGPT and other AI search engines and chatbot experiences.
By the numbers. Even if all ChatGPT’s 1 billion messages per day were search-related, its total share of the search market would be less than 1%. (ChatGPT used search to answer 46% of queries, and only 30% of ChatGPT prompts fell into “traditional” search-like behavior, according to a Semrush study.)
ChatGPT saw an estimated 37.5 million search-like prompts per day, giving it a 0.25% market share. That’s less than Microsoft Bing (4.10%), Yahoo (1.35%), and DuckDuckGo (0.73%).
Google saw ~373 times as many searches as ChatGPT in 2024.
More Google searches. The number of Google searches grew 21.64% in 2024, compared to 2023, based on Datos data.
This data seems to confirm what Alphabet/Google CEO Sundar Pichai said about AI Overviews increasing search usage (“we are seeing an increase in search usage among people who use the new AI Overviews…”).
But. Just because people are searching more doesn’t necessarily mean Google is sending as many clicks or as much traffic to websites. As a reminder, an estimated 60% of Google searches ended without a click in 2024. That means more than 3 trillion searches in 2024 ended without a click.
https://i0.wp.com/dubadosolutions.com/wp-content/uploads/2025/03/growth-google-searches-2023-2024-200x113-qXmSPJ.webp?fit=200%2C113&ssl=1113200http://dubadosolutions.com/wp-content/uploads/2017/05/dubado-logo-1.png2025-03-11 14:27:102025-03-11 14:27:10Google Search is 373x bigger than ChatGPT search
ChatGPT Tasks might be the most underrated tool in SEO today.
It can turn a single employee into a vast team – but only if you know how to use it.
And in this article, you’re about to see the future of SEO.
What is ChatGPT Tasks?
ChatGPT Tasks is a tool within ChatGPT designed to automate various tasks, including those related to SEO, such as content generation, keyword research, and link building.
This feature allows users to schedule tasks to run at specific times, either as one-time events or recurring actions, enhancing workflow efficiency and productivity.
As of writing, it’s in beta and rolling out to users on the Plus, Pro, and Team plans.
How to use ChatGPT Tasks: The basics
The key to maximizing ChatGPT Tasks is to approach it strategically and leverage its capabilities fully.
Start by identifying specific tasks you want to automate, such as:
Creating blog post outlines.
Generating meta descriptions.
Researching competitor backlinks.
Then, explore the tool’s features and experiment with different prompts to find the most effective workflows for your needs.
ChatGPT Tasks is powerful, but it’s not a magic solution.
You must carefully review and refine the output to ensure it aligns with your brand and SEO strategy.
Efficiency gains: The secret to ChatGPT Tasks
One of the reasons ChatGPT Tasks is so powerful is that it optimizes your time.
As an SEO professional using AI, your role will shift from doing work to checking work. That means you need to maximize your efficiency.
In the past, SEOs often outsourced work to overseas staff in different time zones. ChatGPT Tasks changes this.
Now, you can outsource tasks to AI, ensuring they are ready for you when you start your day.
Here’s how I use ChatGPT Tasks: At 7 a.m., AI sends me a batch of completed work.
Beyond that, I’ve also used Tasks to generate content throughout the day.
For example, I set up a content prompt that delivers product description pages to me every 30 minutes. (More on that later.)
Essentially, this feature allows you to maximize “dead time” – periods when you aren’t actively working.
While it doesn’t mean the tool is working around the clock, it ensures you get what you need when needed.
For instance, if you ask it to send you something at 7 a.m., it likely generates it at 6:59 a.m.
But I don’t need to know how it works. I just care that I get what I asked for.
Many SEOs focus on page title optimization, and ChatGPT Tasks makes this process easier.
I use a “dueling” method, where GPT generates multiple page title variations.
I then run them through a tournament-style evaluation to select the best one based on preset criteria.
Social media post ideas
Generating a steady stream of fresh and engaging social media content can be time-consuming. ChatGPT Tasks can help streamline this process.
Here’s an example prompt:
The output of that prompt looks like this:
This is just one of the many prompts I use.
While I only implement about 5% of the generated ideas, they often lead to new inspiration – especially on days when I’m feeling stuck.
Industry news summaries
Staying on top of industry news is essential for SEO professionals.
With ChatGPT Tasks, you can automate this process.
Each morning at 7 a.m., I receive a curated list of SEO and AI news from my preferred sources.
The future of tasks
SEO workflows are rapidly evolving with AI, and ChatGPT Tasks represents a significant step forward.
I suspect there’s still untapped potential. Could I schedule an entire week’s worth of SEO tasks in advance?
For example, if I know I need to work on a client’s account on Wednesday at 11:30 a.m., could I schedule ChatGPT to conduct research or analyze content beforehand?
Looking further ahead, it may eventually ask you what needs to be done – and then suggest the best way to execute it using Tasks.
OpenAI may even develop a single model to streamline this process.
While ChatGPT Tasks is still in its early days, I believe it will evolve rapidly.
https://i0.wp.com/dubadosolutions.com/wp-content/uploads/2025/03/How-to-access-ChatGPT-Tasks-KcG7Xp.png?fit=1600%2C561&ssl=15611600http://dubadosolutions.com/wp-content/uploads/2017/05/dubado-logo-1.png2025-03-11 14:00:002025-03-11 14:00:00How to use ChatGPT Tasks for SEO
500 errors are an HTTP status code that indicates you messed up something and need to start a late-night debugging session.
500 errors are offensive. I can only compare it to eating fermented shark in Iceland – something you’ll want to spit out almost immediately.
500 server errors create a poor user experience and can reduce your crawl budget. If they persist, Google may start ignoring your site altogether. Your website should be commitment-worthy.
If you’re an SEO professional, you’ve likely stayed up until 3 a.m. with coffee and your DevOps team trying to fix a 500 error. You’ll want to keep reading.
I’ll spare you the suspense and admit – it’s usually not a quick fix.
How do I fix ‘Server error (5xx)’ in Google Search Console?
1. Review all the pages under Server error 5xx report
First, I manually reviewed all the pages flagged in the Google Search Console Server error (5xx) report.
To access the report, go to Google Search Console > Pages > and look under the section Server error (5xx).
If the list is extensive, you’ll want to export it to a CSV, Google Sheets, or Excel file to determine a URL structure pattern.
It may only impact a specific subdomain or subfolder.
2. Inspect the URLs in Google Search Console
Once you’re in the Google Search Console error report, click the magnifying glass icon to inspect the URL in Google Search Console.
After you inspect the URL, you can confirm if it’s listed in your XML sitemap.
Start with the pages listed in your XML sitemap that are serving 500 errors. These are your priority pages.
3. Go to the crawl stats report in Google Search Console
Next, go to Settings > Crawl stats report in Google Search Console.
This report shows the crawl request breakdown. Ideally, you’d see less than 1% of server errors (5xx) listed.
4. Analyze server logs
If you’ve got a good relationship with your dev team, you likely have access to server logs.
If you don’t, I understand your struggle. It’s the developers’ natural defense mechanism not to give access to their domain.
The moment you get access to server logs, it feels like a kid at Christmas. Server log files show all the requests made by search engine crawlers.
Server logs give you access to all different kinds of gifts like:
How often a user visited your site.
Time of day.
Pages of your website with the most crawl requests.
If you’re using WordPress, check your outdated plugins. These can be culprits of 500 server errors.
You can either update the plugin or disable it.
Just be sure to backup everything before messing around with plugins.
6. Investigate .htaccess file
If you’re using a CMS like WordPress, Wix, or Squarespace, the .htaccess file is created automatically.
If you’re using a more sophisticated angle of web development, check your .htaccess file for any recent configuration changes.
If you see any changes, save a copy of the new one and revert to the old version.
7. Go back to the most recent server update
If you recently updated your server, there may be some configuration changes that caused something wonky to happen.
While you and Dev dive into the issue, revert the most recent server update until you identify the root cause.
8. Reach out to your hosting provider
I mistakenly hosted my first-built website on GoDaddy in a shared hosting environment. It caused weekly outages on my site.
Eventually, I migrated off of GoDaddy and into a private hosting environment. It saved me hours of work.
9. Upgrade your server
It may be time to ditch your current server and upgrade to a more efficient server with more memory and processing power.
What is a 500 server error?
500 server error is a server-side error caused by your website’s server. This means Google cannot access or index your page.
Server-side errors are a “it’s not me, it’s you” type of scenario.
500 server error response code cheat sheet
Here are a few common 500 server errors and how to address each.
501 – Not implemented: Your server is outdated or has a virus.
502 – Bad gateway: Your server is overloaded or there was an outage – or connectivity issues. Try accessing the page in Incognito mode. If it still doesn’t work, flush your DNS cache.
503 – Service unavailable: The error is likely temporary and will resolve itself. But to be sure, check to see if your server is down. If not, increase your server resources and disable your CDN and plugins.
504 – Getaway timed out: This signals a temporary glitch in your connectivity or your server is overloaded. Always contact your hosting provider. Then, check your server logs. You can also temporarily disable your CDN and check plugins.
509 – Bandwidth limit exceeded: Thismeans your server is having a bandwidth issue. Contact your hosting provider to upgrade your server. Then, compress your website content and minify your code.
524 – Timeout occurred: The connection between your browser and the server is slow. Check your server memory usage and determine if you need to upgrade your server. Then, compress your website content and minify your code.
What if Google Search Console reports a 500 error, but my site is working?
First, double-check that you’ve cleared your cookies and cache files from your browser.
If you’re still seeing the error, this could be a 503 error,
As mentioned above, a 503 error is when your server is overstuffed like a dumpling with crawl requests. Your server can’t handle the number of requests.
In this situation, consider upgrading your server.
Consult your dev team before starting to maintain that solid relationship. This is a temporary and quick solution.
In the long run, you’ll want to identify uncompressed files and begin compressing them.
Don’t fall into the ‘Server error 5xx’ trap in Google Search Console with overloaded servers or poor configuration
If you’ve come across a “Server error 5xx” in Google Search Console, you know how frustrating it can be.
These errors are outdated and unwelcome – like finding a stack of VHS tapes at a flea market.
But 500 server errors can be dangerously unassuming.
Don’t make the mistake of avoiding it. You can’t ignore these errors. It’s one of those impossible errors like washing cigarette smell off your hands.
Grab some booze for a late night with your dev team if you want your website to be meant for search engine consumption.
Let your SEO instincts kick in. Eventually, you’ll develop a vested interest in fixing your 500 server errors.
https://i0.wp.com/dubadosolutions.com/wp-content/uploads/2025/03/500-server-error-google-search-console-IWEeJw.png?fit=1660%2C1719&ssl=117191660http://dubadosolutions.com/wp-content/uploads/2017/05/dubado-logo-1.png2025-03-11 13:00:002025-03-11 13:00:00How to fix the ‘Server error (5xx)’ error in Google Search Console
Why we care. Google Marketing Live is a key event for advertisers, offering insights into the company’s latest ad innovations and AI-driven strategies. As a reminder, here’s everything that was announced at Google Marketing Live 2024.
What to watch. Expect updates on AI-powered ad solutions, measurement tools, and cross-platform marketing strategies as Google continues to evolve its ad ecosystem.
https://i0.wp.com/dubadosolutions.com/wp-content/uploads/2025/03/google-core-updates-1920-800x457-di9PQj.jpeg?fit=800%2C457&ssl=1457800http://dubadosolutions.com/wp-content/uploads/2017/05/dubado-logo-1.png2025-03-10 18:56:142025-03-10 18:56:14Google Marketing Live set for May 21
Similarweb is powerful for digital intelligence. But like any tool, it has limitations.
You might want deeper insights into your competitors’ content strategies. Or need more reliable data for SEO planning. Or you’re simply looking for a more affordable solution.
I’ve spent months testing and researching the best Similarweb alternatives to see how they compare.
Four tools stand out as replacements.
This guide covers the top options for:
Market trends
Advanced SEO analysis
Ad intelligence
Similarweb Limitations
While Similarweb excels at competitor intelligence, it might not fit everyone.
Here are some key limitations:
Limited SEO and keyword research features: It lacks in-depth keyword rankings, SERP tracking, and backlink analysis, making it less effective for SEO professionals
Limited keyword and backlink databases: Similarweb’s databases are smaller compared to its competitors like Semrush and Ahrefs
Limited traffic source breakdown: It doesn’t show a detailed breakdown of where the website gets traffic from (e.g., organic search, social media, referrals, email, etc.)
No granular audience demographics: Unlike some alternatives, Similarweb lacks detailed demographic breakdowns, such as income level or interests, that could help with audience targeting
Similarweb Alternatives at a Glance
Before I review each tool in detail, here’s a quick comparison of the best Similarweb alternatives:
And you’ll get detailed insights into website traffic and visitor behavior that’ll help you refine your marketing strategy.
Let me show you how to use Traffic Analytics to spy on your competition.
Evaluate On-Site Engagement
Metrics like pages per visit, average visit duration, and bounce rate give you a snapshot of what happens when visitors land on the site.
Here’s what these metrics tell you about your competition:
A high bounce rate means most visitors leave without exploring other pages. This often happens when:
The content doesn’t match what visitors were searching for
Pages take too long to load
The site isn’t mobile-friendly
On the flip side, when you see a high average visit duration and multiple pages per visit, it usually means:
Their content keeps readers engaged
They’ve built effective content funnels
Their site navigation makes it easy to explore more content
Analyze Website Traffic Sources
Go to the “Traffic Journey” tab to understand where your competitors’ website visitors are coming from and which channels are driving the most traffic. For example, organic search, paid search, social, or referrals.
What do these metrics mean?
If you see most of their traffic comes from organic search (like in the screenshot above), you’ve struck gold. This usually means:
They’ve built a solid foundation of SEO-optimized content
They’re targeting the right keywords for your industry
They’re not overly dependent on paid traffic
Pro tip: Pay special attention to competitors maintaining steady organic traffic growth. These are the ones whose SEO strategies you’ll want to study and adapt for your own site.
Map Out the Traffic Journey
The Traffic Journey report is like a GPS for your competitors’ visitors. It tracks their exact path before and after they land on the site.
Here’s what different traffic patterns reveal:
Pattern #1: When you see visitors flowing from Google → Your competitor → Stripe (or other payment processors), you’ve found a winning formula:
Their content matches search intent perfectly (thanks to a solid SEO strategy)
Pattern #2: Notice lots of visitors bouncing back to Google.com? That’s a red flag indicating:
The content isn’t delivering what visitors want
There might be technical issues causing frustration
You’ve spotted a gap you can fill with better content
Discover Top-Performing Pages
Navigate to the “Top Pages” tab to identify which pages on a competitor’s site drive the most traffic.
These top pages reveal what resonates most with their audience. This offers inspiration for your content strategy.
Let’s say you run a personal finance blog. You might discover that NerdWallet’s most-visited pages are their:
Mortgage calculator tools
Credit card comparison guides
Student loan refinancing reviews
This tells you three things:
What type of content your audience want (interactive tools and comparison guides)
Which topics drive the most traffic (mortgages, credit cards, student loans)
Where to focus your content strategy for maximum impact
Market Explorer
Market Explorer helps you evaluate your market size and track up to 100 competitors at once.
The tool shows you who’s leading your industry, who’s growing fast, and detailed insights about your target audience’s demographics and behavior.
Here’s what you can do with Market Explorer:
Get a Market Summary
The Market Summary dashboard shows you a snapshot of your chosen industry.
Let’s say you’re just starting a business in the travel and tourism industry. This dashboard gives you the key metrics to evaluate the market and plan your strategy effectively:
Here’s what the key metrics on this dashboard mean:
Market consolidation: Shows if a few big players dominate your market (high consolidation) or if it’s spread across many smaller sites (low consolidation)
Market domains: How many active websites compete in your space
Market traffic: How many monthly visitors the entire industry gets (and whether it’s growing or shrinking)
Market traffic cost: How much you’d need to spend on ads to get the same traffic volume
Market size: Two key numbers that matter:
Total Addressable Market (TAM): Your maximum possible audience size (example: “all online shoppers”)
Serviceable Available Market (SAM): The audience you can realistically reach (example: “online shoppers in your country”)
Analyze Audience Insights
The Audience section provides a detailed breakdown of your industry’s demographics, socioeconomic data, and behavioral trends.
These insights help you understand your target audience on a deeper level. This will allow you to tailor your marketing strategies to their specific needs and preferences.
Market Explorer even shows detailed audience socioeconomic data. For instance, their employment status, education level, and household income and size.
You’ll also see an overview of your audience’s additional interests. And what social media they use the most.
Strengths & Limitations
Strengths
Limitations
Understand where competitors get engagement from (organic search, social media, email, ads)
No mobile app intelligence
Tailored for SEO intelligence as it’s an all-in-one SEO platform
SEOs and content marketers analyzing SEO competition
Market researchers, businesses, or investors analyzing industries
Now, let’s review the key features Ahrefs Site Explorer offers.
View Your Competitors’ Top Pages
Site Explorer lets you identify the highest-value content on your competitor’s website. Plus, the top organic keywords driving that traffic.
Use these insights to replicate their success.
Let’s say you’re running a personal finance blog that competes with NerdWallet. You can analyze their top-performing pages to spot content opportunities.
In this example, the mortgage rates page is one of the most visited. This means that “current mortgage rates” is a high-demand topic worth covering on your website.
Review the Site Structures of Your Competitors
Ahrefs’ Site Structure feature shows a website’s architecture in a tree format with key SEO metrics across each section and subfolder.
This helps you analyze how competitors organize their content and which sections attract the most traffic.
For example, when you analyze one of your competitors, you can see:
Which content categories drive the most organic traffic (e.g., reviews, mortgage guides, or financial calculators)
The traffic performance of individual pages and subfolders
How much organic and paid traffic each section receives, pinpointing opportunities for content optimization
[missing-ss]
Strengths & Limitations
Strengths
Limitations
Helps identify high-value content opportunities
Less emphasis on broader market research
Have a look at competitors’ site architecture
No data on your competitors’ audience (age, location, interests, etc)
Then, for each competitor’s domain, you can access detailed insights, such as:
Domain overview report: Get a bird’s-eye view of their SEO performance, including total organic traffic, keyword rankings, and estimated traffic value
Positions and keywords: See exactly which keywords they rank for, what position they’re in, and how these rankings change over time
Top pages: Discover their highest-traffic content and the exact keywords driving visitors to each page (perfect for finding content gaps in your own strategy)
Backlink profile: Analyze where their backlinks come from, which pages get the most links, and how their link profile grows over time
Site audit: Peek under the hood at their technical SEO setup, including site structure, loading speed, and potential technical issues you can learn from
Why do these insights matter?
They let you reverse-engineer your competitors’ success to improve your SEO strategy.
And find high-authority sites linked to your competitors. Then, reach out to these websites for backlink opportunities.
Best for entrepreneurs and marketers needing early trend insights to capitalize on emerging opportunities
Pricing: Free (paid plans start at $39 per month)
Exploding Topics is a market research and trend discovery tool that identifies emerging trends before they peak.
While Similarweb focuses on existing competitors, Exploding Topics helps you spot rising trends before they take off. The tool analyzes search data, social media, and startup activity to identify tomorrow’s opportunities.
Why is Exploding Topics better than Similarweb?
Let’s take a glance:
Exploding Topics
Similarweb
Primary Focus
Trend discovery and market opportunities
Competitor intelligence and market research
Trend Detection
AI-driven trend forecasting
Relies on historical industry data
Keyword Database
Identifies rising search trends
Tracks established search volume
Competitive Analysis
Limited, focused on macro trends
Detailed competitor insights
Who’s It for?
Entrepreneurs, product developers, investors
Market researchers, large enterprises
Here are the key features included in Exploding Topics:
Discover Emerging Trends Before They Peak
Exploding Topics analyzes millions of data points from search engines, social media, online discussions, and startup investments to identify growing trends.
What does this mean for you?
Let’s say you have an affiliate blog selling home technology. You want to see what’s trending to understand which products or keywords have rising demand before they become mainstream.
Using Exploding Topics, you discover that “walking pads,” compact treadmills designed for home offices, are rapidly gaining traction.
This early insight gives you three key advantages:
You can create content while competition is still low
You can rank for keywords before they get expensive
You can establish yourself as an authority before the trend peaks
In other words: you get more traffic with less effort by being first.
Spot Trends 12+ Months Before They Take Off
Exploding Topics’ forecasting feature can position you as an early authority and rank faster in search.
Imagine creating content around AI image enhancers.
At first glance, it’s hard to tell if the interest in AI-powered image tools will continue to grow or if it’s just temporary hype.
Instead of guessing, you check Exploding Topics’ forecasting data. And see that the search volume for “AI logo generator” is expected to rise steadily.
Knowing the keyword’s popularity may rise gives you the confidence to take action early and secure organic traffic before the competition.
Note: Forecasting is available in Exploding Topics Pro, but you can test it with a 14-day trial for $1. After 14 days, Pro memberships start at $39 per month.
Strengths & Limitations
Strengths
Limitations
Provides long-term trend growth insights
Not focused on competitor intelligence
Predicts emerging trends before they peak
Doesn’t show competitors’ website traffic data
Match Your Similarweb Alternative to Your Growth Stage
Your business stage determines which tool you’ll need.
Just starting out? Exploding Topics gives you free baseline data to validate ideas.
Ready to scale? Semrush .Trends reveals overlooked opportunities in your space.
The right tool accelerates your market research. But knowing how to interpret the data is what drives real growth.
Ready to turn market insights into sales? Our proven market analysis framework shows you exactly how to spot and capitalize on gaps your competitors are missing.
http://dubadosolutions.com/wp-content/uploads/2017/05/dubado-logo-1.png00http://dubadosolutions.com/wp-content/uploads/2017/05/dubado-logo-1.png2025-03-05 22:32:262025-03-05 22:32:264 Similarweb Alternatives for Better Competitor Research
WordPress redirects ensure your users (and Google) can find your content when you:
Change the URL
Combine two pieces of content
Move your entire site to a new domain
Using redirects avoids creating broken links (bad for user experience), or losing the authority of your backlinks (bad for your SEO).
In this guide, I’ll show you how to redirect your WordPress URLs with and without plugins.
When Should You Use WordPress Redirects?
You typically set up WordPress redirects any time you want visitors (and search engines) to end up at a different URL than the one they originally tried to access.
That might be because you changed an old link, or because you’re testing a new landing page.
Here’s a quick breakdown of the most common scenarios:
Use Case
Example
Why It Matters
Changing page URLs
You updated your post slug from /old-page to /new-page
A redirect ensures visitors who save, bookmark, or click the old link don’t land on a 404 error
Deleting or merging content
You remove outdated pages or combine two posts into one
Redirects in these cases ensure you don’t lose valuable backlinks
Rebranding or domain changes
You switch from olddomain.com to newdomain.com
A sitewide redirect preserves your site’s SEO and minimizes traffic lost during the migration
Temporary promotions
You create a holiday sale page that’s active for one week
A temporary (302) redirect lets you direct traffic to the special offer, then you can revert back to the original URL when it’s over
Types of WordPress Redirects
You’ll mostly rely on two key types of redirects: 301 and 302. (Even then, 301 is the type you’ll likely use most often.)
While there are others (like meta refresh), they don’t come up nearly as often in day-to-day site management (and they’re typically not best practice either). So I won’t talk about them here.
There are also subtle variations of these standard redirects (like 307 and 308 redirects). But these have very specific use cases that most site owners don’t need to worry about.
Here’s a summary of what you actually need to know:
301 Permanent Redirect
This is the go-to redirect for any page move that’s meant to last forever. You use it when you’ve changed your URL structure, merged content, or changed your domain.
You use 302 redirects when you plan to send visitors to a new page for a limited time.
This could be when you’re running a seasonal promotion or an A/B test to see which version of your page performs best.
A 302 redirect tells search engines that the old URL is coming back eventually, so they shouldn’t transfer the SEO value to the new page just yet.
What to Do Before You Create WordPress Redirects
Redirecting pages, no matter why or how you do it, always comes with an inherent risk.
It’s easy to make mistakes, like creating redirect chains:
Or redirect loops:
So it’s best to do some planning before you get started.
Understand What Kind of WordPress Site You Own
There are two flavors of WordPress:
WordPress.com: These sites are built on and hosted by WordPress
WordPress.org: These sites run the WordPress software, but you host them elsewhere
Most sites you’ll see talking about WordPress redirects, and everything I’ll discuss below, only really applies to owners of sites running via WordPress.org.
Sites running on WordPress.com typically have more limited customization options, and this applies to redirecting URLs.
For example, users on WordPress’s cheapest plan can’t install plugins, so they won’t be able to redirect URLs with this method.
This means you’ll need to use WordPress’s built-in redirect tool. You can learn more about the different use cases in this support article.
If you run a WordPress.org site (i.e., you pay for separate hosting), you can use either of the methods below.
Create a Backup
It’s always a good idea to back up your site before making any significant changes—redirects included.
Most good web hosts offer an option for this, but you’ll also find external solutions and even WordPress plugins to do it for you.
Create a URL Map
Another good idea if you’re redirecting a lot of URLs or moving to a new domain is to map all of your current URLs to their new versions.
You can do this using tools like Screaming Frog to get a comprehensive list of all your site’s pages. Or, if your site isn’t that big, just create a list manually (with the help of your sitemap).
This gives you a reference for setting up all the redirects. And you can tick them all off as you put them in place and verify that they work.
Consider Whether You Need a Redirect
Finally, consider whether you even need a redirect at all. I’ve covered a few common situations above, but sometimes you might be better off:
Updating the content and keeping the current URL
Deleting the page
Leaving it as is
For example, you might have outdated content or a page that’s no longer relevant, but no relevant page to redirect it to.
But you don’t want to lose the traffic or backlinks that post has attracted over time. In this case, it’s often just best to leave it as is.
Here’s a flowchart to help you decide what to do:
But if you do need a redirect, here’s how to implement them.
Note: It should go without saying that you’ll need to own the domain you’re redirecting. Otherwise anyone could redirect any domain to their own website.
How to Redirect WordPress URLs with a Plugin
Using a plugin is by far the easiest way to handle redirects in WordPress. You don’t have to touch any code, and they’re usually pretty easy to set up.
Here’s an overview of the most popular WordPress plugins for creating redirects:
Plugin
Key Benefit
Price
Redirection
Handles 301 redirects with a simple interface
Free
301 Redirects
Quick setup for basic redirects
Free (with optional paid plans)
Rank Math
Offers advanced SEO tools plus auto-redirects when you change URL slugs
Free (Premium available)
Yoast
All-in-one SEO plugin
Paid (annual license)
AIO SEO
A range of SEO features and simple redirects
Paid (annual plans)
Note: I won’t be going through all the steps for setting each of these up. In most cases, it’s something like this:
Install plugin
Navigate to the redirects/redirections menu within that plugin’s settings
Set up your redirects
I’ll show the main interface for each one below, but it’s pretty self-explanatory. The main things to consider are any other plugin features you might need and whether you can do it for free.
Redirection
Types of redirects: 301/302/303/304/307/308
Redirection is the most popular free plugin for simple 301 redirects.
It does exactly what the name implies and is a plugin purely for creating and managing redirects.
You can add new redirects very easily, and the plugin automatically tracks any 404 errors on your site.
Plus, if you update the URL of a page, you can set it to automatically create a redirect for it.
That means you don’t need to worry about broken links appearing that could cost you traffic and rankings.
You can also choose various HTTP status codes for pages. This is handy if you’re deleting content and want the URL to send a 410 gone status code, for example.
The Redirection plugin can also handle a few useful sitewide redirects:
HTTP to HTTPS
Removing WWW
Adding WWW
As I’ll show you later, you can set these kinds of redirects up through .htaccess. But if you want a simple, no-code way to do it, this is SUPER useful.
If you’re looking for something lightweight and focused purely on redirects, this plugin is a great choice.
301 Redirects
Types of redirects: 301/302/307
301 Redirects is another option if you just want basic link redirection without any extra features.
The free version handles most common redirect scenarios through a simple interface.
But there’s a premium version available if you want other features like:
Redirect management and matching rules
Detailed 404 monitoring
Link scanning
Rank Math
Types of redirects: 301/302/307
Rank Math is an all-in-one SEO plugin that also lets you create redirects—without needing a premium subscription.
Note that you can set up three types of redirects and choose 410 or 451 status codes.
Its standout feature (for this discussion) is the auto-redirect function: when you change a URL slug, the plugin sets up a redirect for you automatically.
This saves you from having to remember to do it yourself.
It also includes an array of other SEO tools—like keyword optimization and schema settings.
So, if you need a plugin that can handle other aspects of your site’s SEO, Rank Math is a good pick.
Yoast
Types of redirects: 301/302/307/410/451
Yoast is one of the most popular SEO plugins for WordPress.
The downside is that you need the premium version to access the built-in redirect manager. If you’re already using Yoast Premium for other features though, it’s a no-brainer.
You’ll get a user-friendly interface for setting up 301 or 302 redirects (and 410/451 status codes), and it’ll automatically set up redirects when you change URLs.
AIO SEO
Types of redirects: 301/302/303/304/307/308
AIO SEO (All in One SEO) is another heavyweight in the SEO world. It offers redirect features, but you need a paid subscription to unlock them.
In return, you get a clean, well-structured dashboard where you can manage redirects alongside other SEO tasks.
Like the others, the redirect manager is straightforward—just enter the old URL, the new URL, and save.
If you’re already using AIO SEO for keyword optimization or sitemap management, upgrading for the redirect module could make sense.
Note: You probably won’t want to use any combination of Rank Math, Yoast, and AIO SEO. They all do many of the same things, and conflicts between them can cause issues with your site.
How to Set Up a Redirect in WordPress via .htaccess
If you’re comfortable taking a more hands-on approach, you can skip plugins entirely and create redirects by editing your site’s .htaccess file.
(Note that this only applies to WordPress sites running on Apache, not Nginx.)
This file tells your server how to handle certain requests, and it’s often used for things like permalinks and redirect rules.
It can be faster than installing a plugin, and if you already have lots of plugins on your site, it limits how much extra “bloat” you add to it.
In other words: your site might run faster.
The catch is that one wrong line of code can bring your whole site down. So I strongly recommend you consult your developer if possible. Or, at the very least, take a lot of care when doing it yourself.
How to Access .htaccess
The usual method to edit your .htaccess file involves an FTP client. This is a “file transfer protocol” program that lets you access your server’s files from your computer.
In many cases, you can edit your .htaccess file right inside your hosting control panel (like cPanel or a similar dashboard).
Look for a “File Manager” or something similar:
Then, look in your site’s root folder (often called public_html) for your .htaccess file.
It might be hidden by default—there’s usually an option in your settings to change that.
You’ll see lines of code that might look a bit intimidating, but don’t panic.
You don’t need to edit any of them. We’ll just be adding some additional lines of code to our .htaccess file.
Before You Start
For some redirects, you’ll need to add a few lines of code like this:
Options +FollowSymLinks
RewriteEngine On
You don’t need to worry too much about what this does, but essentially it lets you add certain rules that’ll execute specific types of redirects. (Some hosts might enable the first line by default, but it’s fine to add it here anyway.)
You don’t need these for a basic single redirect, but you will for the more complex ones.
You also only need to add it once in your .htaccess file (provided you don’t also have “RewriteEngine Off” somewhere else in the file). But I’ve included it in each of the instances below that require it.
Finally, it’s important to note that these .htaccess rules don’t “create” any new pages.
You need to ensure the pages you’re redirecting to are live when you add the rule. Otherwise the redirect will lead to an error page.
With that in mind, here are the most common types of WordPress redirects you can add to your .htaccess file. In each case, add them at the start of your .htaccess file.
Note: The first part (/old-url) should be the relative form of the URL. But the second part should be the full URL, including the protocol (https://) and domain name.
Redirecting a Single Folder
When you want to redirect a folder (e.g., moving a /blog category over to your /news category), use this code:
Options +FollowSymLinks
RewriteEngine On
RewriteRule ^blog/(.*)$ /news/$1 [L,R=301]
Again, you’d replace the blog and news parts with your own folder names.
But what do all the other parts mean?
You don’t need to know the specifics, as there are lots of possible combinations. But this particular case does the following:
^ means “start looking at the beginning of the URL path”
blog/ is the folder we’re redirecting from
(.*) captures everything after blog/ (think of it like copying it to the clipboard)
$ basically says “that’s the end of what we’re looking for”
/news/ is the new folder we’re redirecting to
$1 essentially “pastes” everything we “copied” with (.*) into the new location
L means stop processing rules for this specific request once it matches this rule
R=301 means it’s a 301 redirect (as opposed to 302, for example)
So, it would redirect a URL like:
https://yourdomain.com/blog/post-1
To:
https://yourdomain.com/news/post-1
Redirecting to a New Domain
Redirecting to a new domain is where things can get tricky. Having done this myself, I strongly recommend you speak to your developer first.
But if you plan to do it yourself, here’s one example of a rule you can add to your .htaccess file (obviously subbing in your specific old and new domains, with or without www as required):
This maintains the same structure for each URL but on the new domain.
You can tweak some of the symbols to catch or ignore specific parts of the URL. But again, it’s probably best to seek help from your developer if you need a more precise solution.
Remember: This .htaccess rule doesn’t create any pages on the new site.
If you try to redirect “olddomain.com/example-page” but there’s no “newdomain.com/example-page” or its URL is slightly different (e.g., newdomain.com/example-page1), the user will get a 404 error.
That’s why you should create a redirect map before starting a site move. For more on this, see our website migration checklist.
Redirecting HTTP to HTTPS
You can also redirect your website from HTTP (unsecure) to HTTPS (secure) via .htaccess. (You’ll, of course, need a valid SSL certificate.)
However:
You might not need to. There’s a good chance your web host offers a method to do this for you. Or you might already have a plugin that does it.
In either case, you shouldn’t then add a separate .htaccess rule to redirect to HTTPS. Doing so can actually lead to issues.
But if you do want to add it, here’s the code:
Options +FollowSymLinks
RewriteEngine On
RewriteCond %{HTTPS} off
RewriteRule ^ https://%{HTTP_HOST}%{REQUEST_URI} [L,R=301]
You can copy and paste this rule directly into your .htaccess file without subbing anything in.
Redirecting WWW to Non-WWW
As with redirecting to HTTPS, you can usually redirect from the www. version of your website without touching your .htaccess file.
One method is through your WordPress dashboard’s “General” settings tab. Just enter the URL you want to use for your domain name in the “WordPress Address” and “Site Address Boxes”:
But if you want to do this via .htaccess, here’s the code to add (you can copy and paste it in without changing anything):
Remember: You only need to add one instance of “RewriteEngine On” in your .htaccess file.
Pros and Cons of Using .htaccess for WordPress Redirects
The main advantages of using .htaccess to redirect WordPress URLs include:
Fewer plugins, less bloat: Every plugin you install can slow down your site. Changes to .htaccess don’t rely on lots of extra code running in the background.
Extra control: You can set up advanced redirect rules, and you can be very specific about what does and doesn’t redirect.
Fast execution: Because .htaccess rules run at the server level, your redirects happen quickly.
But there are a few drawbacks:
Risk of breaking your site: One small typo can cause major errors. Double-check everything, and always keep a backup.
No built-in tracking: Unlike plugin dashboards that log errors and hits, you won’t see which URLs have triggered the redirect unless you check your server logs.
Potential performance impact: While the actual redirects might be fast, adding lots of .htaccess rules could impact overall performance and page speed (although it won’t be noticeable in most cases).
A big caveat here, though, is that which method is right for you will depend on how many redirects you need to implement and the nature of them.
Need to redirect a couple of pages, and want an easy way to do it as needed?
The likely small performance impact of a single plugin is probably worth it for the flexibility and convenience.
Redirecting one URL?
It’s probably most efficient to add it to your .htaccess file (it’s just one line of code).
Performing a massive site migration with thousands or millions of redirects?
For massive sites, it’s probably not worth taking any risks trying to use a plugin or editing your .htaccess file. This is where you’ll likely want to seek expert assistance.
How to Check Your WordPress Redirects Are Working
Whether you set your redirects up using a plugin or via .htaccess, I recommend testing to make sure they work as soon as you’ve implemented them. This lets you fix errors before they impact your users (or your SEO).
You can do this manually by checking the URLs if you didn’t create that many redirects.
But if you have lots of them, you can use a tool like Semrush’s Site Audit to check for issues across your entire site.
You just set up your audit and once it runs, you’ll head to the “Issues” tab.
Search for “links” to bring up any relevant issues:
Pay particular attention to these errors and warnings:
# internal links are broken
# pages returned 4XX status code
# redirect chains and loops
# pages with a broken canonical link
# links couldn’t be crawled (incorrect URL formats)
# links on HTTPS pages lead to HTTP page
These often occur when you implement lots of redirects and set up some (or all) of them incorrectly.