The SEO lie: Why more visibility has long ceased to lead to more visitors – rankings rise, traffic collapses

Google as a competitor: How the search engine is systematically drying up the web

AI is not to blame: The real reason why your organic traffic has been declining since 2016

For over a decade, an unwritten law held sway in the digital world: those who managed to get their website to the top of Google search results for the right keywords were rewarded with a steadily growing stream of visitors. It was a simple, predictable equation upon which entire business models, agencies, and media empires were built. But a new, comprehensive long-term study is now ruthlessly shattering this certainty. The analysis of 14 years of search engine data reveals a dramatic decoupling that shakes the foundations of the classic SEO paradigm: while the keyword visibility of publishers has practically exploded, actual traffic is now trickling onto websites only sparsely.

Google has gradually transformed from a guide to the internet into a closed answer engine – a "walled garden" that keeps users firmly within its own ecosystem. Those who attribute today's traffic decline solely to new AI features like AI Overviews overlook the fact that Google has been systematically draining the open web since 2016. For website operators, publishers, and marketers, this means: the old hamster wheel of pure content production no longer works. Those who want to survive in this new digital reality must radically rethink their approach.

Rankings rise, traffic collapses: The end of the SEO gold rush

More keywords, fewer visitors – how Google is systematically draining the web

The Great Ranking Illusion: Why Your Website Traffic Is Declining Even When You're Doing Everything Right

A comprehensive long-term study by xsquareseo.com, analyzing 14 years of search engine data from 43 US publishers, delivers one of the most sobering findings the SEO industry has ever seen. The central insight can be summarized in a single, brutal ratio: the keyword visibility of these publishers increased by 530 percent during the observation period, while the resulting organic traffic grew by only 68 percent. The gap between visibility and actual visitor numbers hasn't just widened slightly—it has now become so expansive that the classic SEO paradigm as an economic model must be fundamentally questioned.

The starting point: What SEO once promised

For years, a simple, almost mechanistic logic prevailed in the digital marketing world: whoever ranks for more keywords in search engines receives proportionally more visitors. This equation was the cornerstone of entire industries. SEO agencies, content farms, publisher networks, and performance marketing strategies built their business models on the premise that Google visibility could be directly translated into website traffic. The promise was enticing in its simplicity: more rankings meant more clicks, more clicks meant more readers or customers, and more readers or customers meant revenue.

This chain of cause and effect worked for over a decade—or at least seemed to. Publishers invested heavily in content production, keyword research, technical optimization, and link building because the return on investment, in the form of organic traffic, was reliable. Google was, in a sense, a fair intermediary: those who produced good content and presented it in a technically sound way received visitors as their reward. Those days are over.

The efficiency problem: 530 versus 68 percent

The key figure from the xsquareseo study is so dramatic that it's hard to believe at first. Over the entire 14-year observation period, the number of keywords for which the publishers studied even appear in the search results grew by 530 percent. That's no small increase—it equates to a sixfold increase in visibility in Google search. At the same time, the resulting traffic only increased by 68 percent. Had the old equation still held true, traffic increases of several hundred percent would have been expected. Instead, the actual growth remained at a level that represents little more than a moderate improvement.

In economic terms: The marginal return on an additional unit of SEO visibility has plummeted. What was once a high, stable ratio of visibility to traffic has transformed into an increasingly flat curve. The industry is working harder than ever – yet reaping less than before. This phenomenon can be described as a structural decoupling of ranking and reach, and it is one of the most significant economic shifts in the history of digital marketing.

The historic turning point: Why the year 2016 changed everything

A common misconception in the current discussion is the assumption that the traffic decline is a new phenomenon and directly attributable to the introduction of AI features like Google's AI Overviews, which were rolled out in 2024. The data from the long-term study clearly refutes this assumption. The decoupling of keywords and traffic demonstrably began around 2016 – roughly eight years before generative AI entered search engines.

What happened in 2016? By that time, Google had already initiated a series of developments that, in retrospect, can be seen as the first steps toward becoming an answer engine rather than a search engine. Featured snippets, knowledge panels, and the increased rollout of structured answer formats had already begun to replace the classic organic click. Google's Knowledge Graph, which presents information about entities directly in the search results, has existed since 2012. Featured snippets, which extract precise answers from websites and display them directly, have been available since 2014. The primary goal of these developments was never to drive more traffic to publishers—it was to keep users within the Google ecosystem for as long as possible.

The AI ​​features rolled out from 2023 and 2024 dramatically accelerated this trend, but did not cause it. Anyone who attributes the declining click-through rates solely to AI Overviews is overlooking the structural causes that have been at work for a decade. This is not a minor point – it is a fundamental strategic miscalculation that can lead to incorrect responses.

The Google ecosystem as a silo: How traffic is systematically held back

To fully understand the economic consequences, one must imagine the Google ecosystem as a closed system increasingly focused on keeping users within its own platforms. A 2024 study by SparkToro and Datos shows that in the US, 58.5 percent of all Google searches end without a single click on an external website. In Europe, the figure is 59.7 percent. For every 1,000 search queries in the US, only 360 clicks lead to the open web. Nearly 30 percent of all clicks, however, land on Google's own platforms – YouTube, Google Maps, Google Images, and Google Flights.

This finding is remarkable in its clarity. Google has transformed itself from a directory of the web into a competitor of the web. Search is no longer primarily a bridge between users and content—it has become a content system in its own right. Every search query that Google answers with a Knowledge Panel ad, a Featured Snippet, a Local Pack, or an AI Overview is a search query for which no external publisher receives traffic. And the number of these response formats grows with every Google product development.

AI Escalation: What AI Overviews Actually Do

Since the launch of Google's AI Overviews in May 2024, the pace of traffic erosion has noticeably increased – even though, as explained, the structural cause lies much earlier. Specific studies confirm the extent of this: An analysis by Ahrefs of over 300,000 keywords showed that the presence of an AI Overview reduces the click-through rate (CTR) for the top result by 34.5 percent. A parallel study by Amsive of over 700,000 keywords found an average CTR decline of 15.49 percent, with drops of up to 37.04 percent measured for certain combinations with featured snippets.

For Germany, a SISTRIX analysis of over 100 million keywords delivers particularly striking figures: When an AI Overview appears, the click-through rate for position 1 in the organic results drops from 27 percent to just 11 percent – ​​a decline of 59 percent. SISTRIX estimates that this translates to 265 million lost organic clicks per month in the German market. A Pew Research study from the US complements this finding: Without an AI Summary, the click-through rate is 15 percent – ​​with an AI Summary, it falls to 8 percent, and browsing sessions end after viewing an AI Summary in 26 percent of cases, compared to 16 percent without.

The consequences for major news publishers are now existential. Traffic to CNN has fallen by around 30 percent year-on-year. Business Insider and HuffPost have seen declines of around 40 percent. A Reuters Institute survey of 280 media executives from 51 countries revealed that publishers expect an overall drop of over 40 percent in search engine traffic. Rand Fishkin, one of the world's leading SEO experts, puts the decline in traffic from Google to major publishers at 47 percent over a three-year period.

The structural contradiction: Impressions grow, clicks die

One of the most paradoxical aspects of this development is that the total number of search queries isn't decreasing—it's actually increasing. Google processes around 8.5 billion search queries worldwide every day. Impressions, meaning the frequency with which a website appears in search results, continue to rise for many publishers. A study shows that search impressions increased by 49 percent during the study period, while click-through rates simultaneously fell by 30 percent. This is the statistically perfect illustration of the problem: you're seen more often, but visited less frequently.

This paradox has profound economic consequences. Advertising-funded publishers, whose revenue model relies on page views, find themselves in a bind. Visibility metrics—impressions, ranking positions, keyword coverage—often show positive figures, while the key business metric, actual traffic, steadily declines. SEO reports that focus solely on rankings obscure the true economic reality. A website can rank exceptionally well and still experience economic stagnation or even decline.

The search engine market: Google between monopoly and transformation

To fully grasp the extent of this power shift, one must consider Google's market position. Google processes an estimated 8.5 billion search queries daily and holds a global market share of over 90 percent in the search engine market. This monopoly gives Google economic power that is virtually unprecedented in the history of the digital economy: The corporation can unilaterally change the rules of the game for the distribution of web traffic without consulting the publisher community.

Google's stated goal—and this goal is strategically coherent from the company's perspective—is to answer user questions directly, without requiring an external click. This increases the time spent on Google's own pages, improves the data available for advertising purposes, and makes Google more convenient for users. For publishers and website operators, it means the exact opposite: their content is used as raw material to improve Google products, while the return on investment in the form of traffic steadily declines. The question of whether this model is compatible with a healthy web ecosystem in the long term is now the subject of regulatory debates in the EU and the US. Google's AI Mode and AI Overviews are merely the latest escalation in a development that has been ongoing for years.

The quasi-in-house solution: How Xpert.Digital closes operational gaps in B2B marketing and sales – Smart Content-Driven Business - Image: Xpert.Digital

Xpert.Digital is a data-driven B2B industry hub led by Konrad Wolfenstein . The company acts as an external, quasi-in-house solution for industrial partners, closing operational gaps in marketing, content, and sales – without requiring additional resources on the client side.

More information here:

• The quasi-in-house solution: How Xpert.Digital closes operational gaps in B2B marketing and sales – Smart Content-Driven Business

What the data means for mid-sized publishers

The effects of traffic erosion are not evenly distributed. Studies show that the most significant losses are seen among mid-sized publishers—those ranking between 100 and 10,000 of the most visited US websites. The very largest websites, the top 10, were even able to slightly increase their organic traffic by about 1.6 percent. For them, the mechanisms of brand power apply, with direct search queries and branded queries dominating. Mid-sized publishers, who lack such brand awareness and rely more heavily on generic information searches, are in a structurally disadvantaged position.

AI Overviews hit informational search queries particularly hard – precisely the kind of search queries that many advice websites, news outlets, and specialist publications focus on. Ahrefs' data shows that 99.2 percent of the keywords affected by AI Overviews are informational in nature. Search terms with a commercial or transactional character – that is, queries where users want to buy something – are significantly less affected. This explains why e-commerce providers and SaaS companies are comparatively better positioned than purely ad-supported content publishers.

The wrong answer: More content than symptom treatment

Faced with declining traffic, the intuitive reaction of many publishers is to produce even more content – ​​to cover more keywords, publish faster, and roll out larger volumes of content. This strategy is not only ineffective, it's counterproductive. The long-term study shows precisely why: If a fivefold increase in keywords only leads to a 68 percent increase in traffic, then a further doubling of keyword coverage leads to a further decoupling of investment from return. Marginal costs rise, and marginal benefits decrease.

This pattern is classic in economic saturation scenarios: A market that once offered attractive returns on content investments has reached its saturation point – not because of a lack of supply, but because of structural shifts in demand on the platform side. Publishers who continue to rely solely on keywords and traffic are essentially running on a hamster wheel: They keep speeding up in order to slow down. The solution lies not in intensifying the same strategy, but in a fundamental rethink.

The correct answer: Brand building and direct channels as an economic protection strategy

The xsquareseo study explicitly recommends shifting the strategic focus from pure keyword accumulation to two alternative pillars: building brand demand and developing direct communication channels to the audience. This recommendation sounds like marketing platitudes, but in reality, it represents a profound strategic realignment that requires significant resources and thought.

Brand awareness protects against traffic erosion in a way that generic SEO cannot: Users who know and trust a brand search for it directly – as a branded query. These searches trigger AI overviews less frequently (only 4.79 percent of branded queries), and when they do, the click-through rate increases by as much as 18.68 percent. Brand awareness thus acts as insurance against the worst effects of AI taking over search results. However, it requires long-term investments in quality journalism, exclusive content, thought leadership, and a continuous presence on channels beyond Google.

Direct channels—especially email newsletters, proprietary apps, podcast subscriptions, and community platforms—offer a different kind of protection: they completely shield the reader relationship from Google's reach. A subscriber who regularly opens a newsletter is immune to Google's algorithm changes. These channels are costly to establish and grow slowly, but they offer an economic stability that no ranking can ever guarantee. Publishers like The Atlantic, The Financial Times, and The Economist made this shift early on and now benefit from reader solidarity that external platforms cannot simply take away.

New metrics for a new reality

A practical problem arising from the decoupling of rankings and traffic is the question of how to properly measure success. If traditional SEO metrics—ranking positions, keyword coverage, organic impressions—no longer reliably indicate economic success, companies need other metrics. Experts recommend shifting to key performance indicators (KPIs) that reflect actual business relevance: high-quality brand searches, direct traffic shares, email subscriber numbers and their engagement rates, and—where available—subscriber conversion rates.

Furthermore, new dimensions of visibility become relevant in the context of generative AI searches: the frequency with which a brand is cited in AI overviews, its positioning in AI-powered search results on Perplexity, ChatGPT, or Gemini, and its ability to be perceived as an authoritative source within these systems. This shift from traditional SEO to so-called AEO (Answer Engine Optimization) or GEO (Generative Engine Optimization) is not a fringe phenomenon—it is the next essential strategic task for anyone who wants to maintain digital visibility.

Google Discover as a counter-movement: Opportunities and limitations

Amidst the bleak traffic statistics, there is a glimmer of hope, but it needs careful evaluation. Google Discover—the AI-powered content feed product for mobile devices—has seen significant growth in several studies. One analysis shows that Google Discover has now surpassed Google Search traffic in some publisher portfolios. This turns the traditional SEO model on its head: no longer does active search queries drive visitors to websites, but rather an algorithmically curated feed based on individual user behavior.

The economic quality of this Discover traffic is, however, debatable. There is evidence that traffic generated through Discover exhibits lower conversion rates and poorer monetization characteristics than search traffic. A user who encounters an article through Discover has not expressed an explicit search interest – they are a passive recipient rather than an active researcher. Nevertheless, Discover can be a useful supplementary source for high-volume, ad-supported publishers. It is not sufficient to replace lost search traffic, especially for B2B publishers or specialized trade publications whose target audiences have very specific information needs.

The regulatory dimension: competition and data power

Google's structural traffic diversion is not just a marketing problem – it's a competition law and media policy issue. The European Commission and the US Department of Justice have targeted Google in various proceedings, including for its dominant market position in search. The core problem from a regulatory perspective is that Google acts as a gatekeeper of web traffic while simultaneously competing with the publishers whose content it indexes through its own services. When Google summarizes news content in an AI overview and prevents users from clicking through to the source, it profits from others' creative work without providing adequate compensation.

In Australia, the so-called News Media Bargaining Code has already set priorities: platforms like Google and Meta are required to pay for the use of publisher content. Similar discussions are underway in the EU under the Digital Markets Act and in Canada. These regulatory efforts reflect a growing political understanding that a healthy media ecosystem is incompatible with a platform model that exploits content without adequately compensating producers. The long-term study by xsquareseo.com provides hard data for these debates: the structural disadvantage publishers face compared to Google is not merely a perception—it is measurable and has been documented for a decade.

Conclusion: The new economic reality of digital content

The 14-year study is a snapshot of a tectonic shift in the internet economy. The ratio of 530 percent to 68 percent is not a statistical artifact – it is the numerical expression of a fundamental power shift between platforms and publishers that has been underway for about a decade and is now being dramatically accelerated by generative AI.

For website operators, publishers, agencies, and content strategists, this means that the SEO model based on the simple equation "more keywords equals more traffic" is no longer economically viable. It has been replaced by a more complex model in which platform dynamics, brand equity, audience relationships, and content quality are the decisive variables. Those who continue to invest solely in rankings and fail to build direct audience relationships are playing a game whose rules are set by someone else—and to their own disadvantage.

The title of this study – “Ranking More, Getting Less” – could be read as an epitaph for the classic SEO era. It precisely describes what happens mathematically when the efficiency of a strategy systematically approaches zero. The question isn't whether this trend will continue – the data is clear. The question is who will recognize quickly enough that a new game is being played and who will be prepared to make the investments in branding, direct communication, and content excellence that will ensure long-term economic viability in the digital space.

☑️ Our business language is English or German

☑️ NEW: Correspondence in your native language!

Konrad Wolfenstein

I and my team are happy to be available to you as your personal advisor.

You can contact me by filling out the contact form here simply call me at +49 7348 4088 965. My email address is [email protected]:or

I'm looking forward to our joint project.

☑️ SME support in strategy, consulting, planning and implementation

☑️ Creation or realignment of the digital strategy and digitization

☑️ Expansion and optimization of international sales processes

☑️ Global & Digital B2B trading platforms

☑️ Pioneer Business Development / Marketing / PR / Trade Fairs

B2B support and SaaS for SEO and GEO (AI search) combined: The all-in-one solution for B2B companies - Image: Xpert.Digital

AI search changes everything: How this SaaS solution will revolutionize your B2B ranking forever.

The digital landscape for B2B companies is undergoing rapid change. Driven by artificial intelligence, the rules of online visibility are being rewritten. For companies, it has always been a challenge not only to be visible in the digital mass, but also to be relevant to the right decision-makers. Traditional SEO strategies and managing local presence (geo-marketing) are complex, time-consuming, and often a battle against constantly changing algorithms and intense competition.

But what if there were a solution that not only simplified this process but also made it smarter, more predictive, and far more effective? This is where the combination of specialized B2B support with a powerful SaaS (Software as a Service) platform comes into play, specifically designed for the demands of SEO and GEO in the age of AI search.

This new generation of tools no longer relies solely on manual keyword analysis and backlink strategies. Instead, it leverages artificial intelligence to more accurately understand search intent, automatically optimize local ranking factors, and conduct real-time competitive analysis. The result is a proactive, data-driven strategy that gives B2B companies a decisive advantage: they are not only found, but perceived as the leading authority in their niche and location.

Here's the symbiosis of B2B support and AI-powered SaaS technology that transforms SEO and GEO marketing, and how your company can benefit from it to grow sustainably in the digital space.

More information here:

​

• B2B Support & Blog for SEO, GEO and AIS – Artificial Intelligence Search
• Forget expensive SEO tools – this alternative dominates with unbeatable B2B features