The Personalization Gap

FastArcher · Industry Research Brief / 2025

The
Personalization
Gap

Why 85% of companies believe they’re delivering personalized experiences. Only 60% of their customers agree. A data-driven look at the real barriers to CRO, experimentation, and personalization at scale.

FastArcher · fastarcher.com
Research synthesis drawing from
Optimizely · Twilio Segment · Medallia · Adobe · McKinsey
Salesforce · CXL · VWO · CMSWire · Forrester · Contentful
0.2%
of all websites run structured A/B tests

$1
spent on CRO for every $92 on acquisition

25pt
gap between company confidence and customer reality

The marketing world has been talking about personalization for a decade. The tools have never been better. The data has never been richer. The business case has never been clearer. And yet, most companies are stuck: running a handful of surface-level tests each month, believing they’re data-driven while still making key decisions based on gut feeling, and spending a fraction of what they should on actually converting the traffic they’ve already paid for.

This brief synthesizes findings from over a dozen major industry surveys and reports, covering 1,000+ executives, hundreds of CRO practitioners, and millions of A/B tests, to give an honest picture of where the industry actually stands in 2025.

“Companies are doubling down on personalization. Their customers? Largely unimpressed.”
Forrester State of US Consumer Personalization, 2024 [26]

01

The Confidence Gap

Let’s start with the most revealing tension in the data. When companies and customers were asked independently about the quality of personalized experiences, the results told completely different stories.

85%
of companies say they provide personalized experiences
Contentful / Multiple sources, 2024–25

60%
of customers actually agree they receive them
Contentful / Multiple sources, 2024–25

86%
of executives privately admit their personalization capability is inadequate
Optimizely / Wakefield Research, 2024

That 25-point gap between corporate confidence and customer experience is not a blip. It appears consistently across every major research study from 2024 to 2025. Companies are essentially grading themselves on a curve.

What explains it? Executives are counting the tools they’ve purchased and the campaigns they’ve deployed. Customers are counting the moments where they actually felt understood. These are very different measurements. Right now, the industry is measuring the wrong one.

Key Finding

Businesses overwhelmingly believe they’re personalizing. Their customers largely disagree. Even more striking: 86% of executives admit their own capabilities are inadequate. Yet nearly all senior marketers describe their personalization strategies as “successful.” [1] The system is rewarding effort and activity, not outcomes.

02

The Adoption Reality

Before examining why personalization programs fail, consider just how few companies have a real program at all. The numbers are more extreme than most people expect.

0.2%
of all websites globally run structured A/B testing programs
BuiltWith Technology Tracking, via Convert 2025

32%
of the top 10,000 highest-traffic sites use an experimentation platform
BuiltWith Technology Tracking, via Convert 2025

42%
of businesses run A/B tests even once per quarter
Marketing LTB CRO Statistics Compilation, 2025

This isn’t an optimization problem : it’s an adoption problem. The market splits across the maturity spectrum. Most businesses are Foundational or Not Started — they haven’t meaningfully begun. A larger middle tier is Early Stage or Developing: running occasional tests, shipping some segments, but no structured program underneath it. A small minority are at Advanced or Optimized, compounding advantages month over month.

Adoption rate of A/B testing by site tier
Top 10,000 sites
32%

Top 100,000 sites
21%

Top 1M sites
11.5%

All ~1.2B websites
0.2%

Source: BuiltWith Technology Tracking data, as reported by Convert (2025). Note: Server-side and custom platforms are likely undercounted.

For companies outside the elite tier, the biggest gap isn’t optimization quality. The real gap is the absence of any structured program at all. This is simultaneously the problem and the opportunity.

03

Getting Started: The Real Blockers

When companies try to launch personalization or CRO programs, they hit a consistent set of barriers. The research points to four primary obstacles. Notably, “finding the right tool” is not among the top ones.

1
The data foundation isn’t there

Fragmented data is the single most cited blocker across every major study. Customer information lives across CRM, ecommerce, analytics, email, and ad platforms, and rarely talks to itself. 54% of marketers identify fragmented and siloed data as the biggest barrier to leveraging customer data.[2] 75% say it makes customer engagement significantly harder.[3] Without a unified view of a customer, “personalization” becomes guesswork dressed up as strategy. The irony: the data typically exists. It’s just not connected.

2
Nobody agrees on what personalization means

Only 26% of executives report having a unified definition of personalization across their organization.[4] When marketing, product, data, and engineering all have different mental models of what “personalized experience” means, programs collapse before they launch. This isn’t a semantic quibble. Misaligned definitions directly drive misaligned metrics, misaligned ownership, and misaligned incentives. Getting buy-in for CRO is the #2 post-COVID challenge for practitioners, right behind building proper processes.[5]

3
Budget allocation is structurally backwards

The average company spends $1 on CRO for every $92 spent on customer acquisition.[6] Companies invest heavily to get traffic to their site, then spend almost nothing on converting it. More than half of businesses allocate less than 5% of their total marketing budget to conversion optimization, despite evidence that companies dedicating more than 5% see 4x higher conversion lifts.[7]

4
Tech complexity without tech strategy

28% of businesses cite “siloed systems, technology integration challenges, and fragmented customer data” as a top-three barrier, nearly as significant as budget.[8] Most marketing tech stacks have a CDP, an analytics platform, a testing tool, and a CMS. The problem isn’t the absence of tools. It’s that they don’t operate as a system. Poor data quality resulting from integration failures costs U.S. businesses an estimated $3.1 trillion annually.[9]

Put This In Context

The data above describes where the industry stands. What matters more is where your program stands. Most teams overestimate their maturity by one to two levels. The assessments below take under 15 minutes and tell you specifically which gaps are holding your program back.

Experimentation Program Assessment →
   
Personalization Maturity Assessment →

04

Running It In-House: What Goes Wrong

For companies that do get a program off the ground, a different set, often more frustrating, of problems emerges. These are the challenges that kill mature programs or keep them permanently stuck at “good enough.”

“We’re running more tests than ever. Why isn’t this moving our bottom line?”
Fortune 500 Retailer CEO, as reported by Optimizely, 2024

The Vanity Metrics Trap

Teams celebrate test velocity and “win rates” while the actual business needle doesn’t move. Most “wins” are cosmetic changes : button colors, headline tweaks that generate a statistically significant result in the testing tool but meaningful-zero business impact. 58% of companies still make website changes based on opinions, not data.[10] Real programs don’t just run more tests. They run better ones.

Proving ROI Is Chronically Hard

No single ROI metric is used by even half of respondents in any major survey.[11] 82% of marketers say learning to track and test conversion rates is “highly or moderately challenging.”[12] 43% fear that an ineffective personalization campaign will directly result in reduced future marketing budgets.[13] The inability to prove impact creates a vicious cycle: low confidence → low investment → low results → lower confidence.

The Velocity Wall

Most companies run 2–3 A/B tests per month. Best-in-class programs run thousands per year. Booking.com runs over 25,000 annually, roughly 70 per day.[14] The difference isn’t just ambition. It’s infrastructure, culture, and the willingness to make experimentation a first-class organizational priority rather than a marketing side project.

Personalization Doesn’t Scale

Only 35% of businesses offer truly omnichannel personalized experiences.[15] 41% of retail executives say their platform is “somewhat personalized.”[27] Only 33% of businesses have fully implemented AI despite 71% having tried it : 47% remain permanently in “experimental phases.”[16] Getting from tactics to systems is the wall most programs never clear.

05

Diagnosing the Gap: What’s Actually Broken

Ask a business why their personalization or CRO program isn’t working and they’ll usually say “we need better tools.” The research suggests this is the wrong answer, or at least, the last answer. Here’s the gap hierarchy that actually maps to outcomes.

Gap type
What it looks like
Severity

Primary
Data & System Gap

Fragmented data across platforms, no unified customer view, clean data that can’t reach execution systems. 97% of executives acknowledge data silos hurt their business. Yet 47% still operate with siloed data.[17] This is the root cause, not a symptom.
01

Secondary
Skills Gap

63% of digital marketing executives struggle to deliver tailored experiences.[18] Only 17% use AI/ML extensively despite 84% believing in its potential.[19] Strong hypotheses, statistical literacy, and journey thinking are rare skills. AI augments them, it doesn’t replace them.
02

Tertiary
Resource Gap

Only 37% of organizations have a dedicated CRO specialist.[20] Dev bandwidth bottlenecks test velocity. Content creation can’t keep pace with the volume of variants needed. Personalization gets treated as a campaign, not a function.
03

Most Blamed
Tools Gap

Almost always a symptom, rarely the cause. 36% cite disjointed workflows as a top challenge, but this is typically an integration and process failure, not a tool feature failure. Most companies already own the tools they need. They underutilize what they have.
04

Deepest / Least Named
Culture Gap

“Finding exceptional cultures where experimentation is taken seriously is a rarity. The answer boils down to whether there’s commitment from leadership.”[21] Without executive buy-in and a genuine willingness to let data challenge assumptions, every other investment is wasted.

06

The Maturity Ladder

Understanding where a program sits on the maturity ladder explains almost everything about its outcomes. Most companies aren’t just “doing personalization poorly” : they’re operating at a fundamentally different stage than they think.

Foundational / Early Stage
Not Started or Beginning

Occasional A/B tests, basic email segmentation, disconnected tools. Decisions still driven largely by opinions. No documented process, no dedicated owner.

Most companies live here
Developing
Building but Not Yet a System

Running regular tests, some segmented campaigns, a partial tech stack. Measuring activity (tests run, win rate) rather than impact. Typically overestimates its own maturity by one or two levels.

Advanced / Optimized
Operating a Growth System

Always-on experimentation culture, unified data infrastructure, AI-driven decisioning, full-journey optimization. Each test informs the next. A genuine system of compounding growth.

The gap between Developing and Advanced is not a tool purchase. It’s a structural and cultural shift, from running campaigns to operating systems. Advanced and Optimized programs generate 40% more revenue from personalization than their slower-growing competitors.[22] That gap doesn’t narrow incrementally. It compounds.

07

The Privacy Constraint

Personalization doesn’t just face an internal execution problem. It also faces an external trust problem that is structurally worsening.

97%
of executives feel unprepared for the cookieless transition
Optimizely / Wakefield Research, 2024

50%
of companies say privacy regulations have made personalization harder
Twilio Segment, 2024

37%
of customers trust companies with their personal data
Jack Morton, cited in Contentful 2025

The third-party cookie era — which enabled most of what companies called “personalization” for the past decade — is under sustained pressure. Safari and Firefox already block third-party cookies by default. Google reversed its original plan to deprecate cookies in Chrome, opting instead for user-level controls — but the broader direction of travel is clear. Regulatory pressure, browser-level changes, and rising consumer awareness of data privacy are collectively making third-party data a less reliable foundation to build on.

The organizations ahead of this shift are rebuilding their data infrastructure around first-party data, explicit consent, and direct value exchange. 53% of business leaders are upgrading their data management infrastructure in direct response to privacy changes.[23] The companies treating this as a crisis are losing time. The companies treating it as a forcing function to build better, more durable data relationships are pulling ahead.

08

Investment Intent: Are Companies Spending More?

Despite all the obstacles, investment in personalization and CRO is growing, and accelerating with AI.

Investment signals across personalization & CRO
Increasing personalization investment
69%

Planning AI-powered CRO tools
72%

Increased CRO budgets (vs. prior year)
55.5%

Upgrading data mgmt for privacy
53%

Using AI personalization in some form
92%

Sources: Twilio Segment 2024 · SuperAGI / Gartner · Keywords Everywhere · Twilio Segment 2024 · Shopify / Segment Report 2024

The A/B testing tools market alone hit $969M in 2025 and is projected to grow at 14% CAGR through 2031.[24] Marketers now allocate roughly 40% of their budgets to personalization, up from 22% in 2023.[25] Money is moving. But money without maturity compounds the wrong things.

09

Where the Industry Is Headed

The transformation underway isn’t just about better tools or more budget. The fundamental model is changing, moving from campaign-based personalization to always-on, AI-driven optimization systems. Most companies are caught between these two worlds.

The old model
Periodic A/B tests
Campaign-based personalization
Manual rule creation
Segment-level targeting
Third-party data dependent
CRO as a marketing function
Tools measured in isolation

The emerging model
Always-on experimentation
Journey-level optimization
AI-driven decisioning
Individual-level personalization
First-party data ecosystems
Experimentation as company culture
Integrated systems with shared data

The companies winning today share a few common traits: they treat personalization as an organization-wide capability rather than a marketing department activity; they prioritize customer lifetime value over short-term conversion wins; and they’ve built infrastructure where data, insight, testing, and execution operate as a unified loop, not separate tools maintained by separate teams.

10

What This Means: Six Takeaways

I
The biggest gap is adoption, not quality

Only 0.2% of all websites run structured A/B tests. The conversation about “better personalization” is irrelevant for the majority of businesses who haven’t started. The first question to answer isn’t “how do we get better?” The real question is: “how do we actually start?”

II
Data infrastructure is the unlock, not tools

Companies that invest in connecting and activating their data before acquiring new tools consistently outperform those that don’t. Getting clean, unified, real-time data to the execution layer is the foundation. Everything else is built on top of it.

III
Most programs are stuck at tactical, and don’t know it

The maturity self-assessment gap is real. Companies running 2–3 tests per month believe they’re doing CRO. They’re not; they’re practicing it occasionally. The difference between practicing and having a system is the difference between results and compounding results.

IV
Privacy isn’t a headwind. It’s a forcing function

The cookieless transition is painful for companies whose personalization depended on third-party data. It’s an accelerant for companies building direct, consent-based customer data relationships. The winners here aren’t the most sophisticated. They’re the most proactive.

V
AI is a skills multiplier, not a skills replacement

73% of business leaders say AI will reshape personalization. But only 17% currently use it extensively. AI makes execution faster and hypothesis generation easier, but it amplifies bad strategy as efficiently as good strategy. The skills gap is real and growing.

VI
The ROI is not in question. The path is.

Fast-growing companies generate 40% more revenue from personalization than competitors. Companies running structured CRO programs see average ROI of 223%. Marketers who prioritize CRO are 3.5x more likely to report year-over-year revenue growth. The business case is settled. The execution path is where companies get lost.

The Next Step

The data shows where the industry stands. These tools show where you stand.

Both assessments are free and take under 15 minutes. The results identify specifically which gaps are limiting your program and what to address first. No benchmark averages. Your program, scored against a structured maturity model.

Assessment 01
Experimentation Program Assessment
Scores your program across 18 characteristics: hypothesis quality, test velocity, statistical discipline, organizational buy-in, knowledge management, and more. Identifies exactly where your program is stuck and what to fix first.

Take the Assessment →

Assessment 02
Personalization Maturity Assessment
Evaluates your personalization capability across strategy, data infrastructure, segmentation, technology fit, and execution. Reveals whether your program has a strategy problem, a data problem, a skills problem, or a tools problem.

Take the Assessment →

Already know you have a gap and want to move faster? FastArcher works directly with marketing teams to diagnose exactly what’s broken and build the growth system to fix it. The assessment is the starting point. Direct consulting goes deeper.

Talk to FastArcher →

About
FASTARCHER

FastArcher is a growth systems consultancy. We’ve spent two decades inside and alongside some of the world’s most recognized brands, building experimentation programs, designing personalization strategies, and architecting the measurement systems that connect marketing investment to real business outcomes. The pattern we keep seeing: talented teams working hard without a system underneath them. The brief you just read is how we think. If it named something you’ve been feeling, the assessments above are the right next step.

Sources & Citations

[1]
Statista, 2024–25 : Survey of senior marketers on personalization strategy success rates. Cited via Contentful Personalization Statistics compilation, January 2025.

[2]
Emarsys Blog : “Break Down the Silos or Break Your Customer Experience.” Cites multiple sources including McKinsey and Accenture on data silos in marketing.

[3]
Adobe 2025 AI and Digital Trends Report : Brands cite data fragmentation as one of the top obstacles to delivering relevant, real-time experiences. Reported via Adobe business blog, 2025.

[4]
Optimizely / Wakefield Research, 2024 : Survey of 1,000 Marketing, Ecommerce, and IT Executives across US, UK, Germany, Sweden, Australia/NZ, and Singapore. Conducted May 2024.

[5]
CXL: State of Conversion Optimization Report, 2020 : “Post-COVID, the two biggest challenges with CRO are buy-in from decision-makers and the need for better processes.” Cited via DemandSage CRO Statistics, 2025.

[6]
Keywords Everywhere / Multiple Sources : “Companies typically spend only $1 on CRO for every $92 they spend on getting new customers.” Keywords Everywhere Blog, CRO Statistics, 2025.

[7]
Marketing LTB CRO Statistics Compilation, 2025 : “Businesses dedicating more than 5% of their budget to CRO see 4× higher conversion lifts.” Cross-referenced via multiple practitioner reports.

[8]
CMSWire: 2025 State of Digital Customer Experience Report: Survey data on leading barriers businesses face when trying to unlock AI’s full potential in digital experience.

[9]
Harvard Business Review : “Poor data quality results in $3.1 trillion in losses annually for U.S. businesses.” Cited via Insider (useinsider.com) Data-Driven Personalization guide, 2025.

[10]
Marketing LTB CRO Statistics Compilation, 2025 : “58% of companies still make website changes based on opinions, not data.”

[11]
Optimizely / Wakefield Research, 2024 : “While virtually all executives surveyed with a personalization strategy are measuring their ROI, no single metric is used by even half of respondents.”

[12]
Transaction Agency, cited by DemandSage : “82% of marketers said that learning how to track and test conversion rates successfully is highly or moderately challenging.”

[13]
Optimizely / Wakefield Research, 2024 : “43% fear an ineffective personalization campaign will result in reduced future marketing budgets.”

[14]
VWO Blog, Paras Chopra: “How to Run 25,000 A/B Tests in 2024.” References Booking.com experimentation culture and volume benchmarks.

[15]
Marketing LTB / Multiple Sources : “Only ~35% of businesses offer truly omnichannel personalized experiences.” Personalization Statistics, 2025.

[16]
Envive AI / E-commerce AI Implementation Statistics, 2025 : “Only 33% have fully implemented AI despite 71% trying it; 47% remain in experimental phases.”

[17]
Emarsys Blog : “97% of executives say data silos are negatively impacting their business; 47% of marketers say some part of their customer data is siloed and difficult to access.”

[18]
Contentful Personalization Statistics, January 2025 : “63% of digital marketing executives struggle with providing tailored customer experiences.”

[19]
Contentful Personalization Statistics, January 2025 : “Only 17% of marketing executives currently use AI/ML extensively, despite 84% believing in its potential for personalization.”

[20]
Marketing LTB CRO Statistics Compilation, 2025 : “37% of organizations have a dedicated CRO specialist.”

[21]
VWO Blog, Paras Chopra, Founder & Chairman : “Finding exceptional cultures where experimentation is taken seriously is a rarity. The answer boils down to whether there’s a commitment from the leadership.”

[22]
McKinsey & Company : “Fast-growing companies generate 40% more revenue from personalization than slower-growing competitors.” Cited across multiple aggregators; sourced to McKinsey’s personalization at scale research.

[23]
Twilio Segment: State of Personalization Report, 2024 : “53% of business leaders are upgrading their technology for customer data management following changes in data privacy.”

[24]
Loopex Digital CRO Statistics, 2025–2026 : “The global A/B testing tools market reached $969M in 2025 and is projected to grow at 14% CAGR through 2031.”

[25]
Marketing LTB Personalization Statistics, 2025 : “Marketers now allocate ~40% of their budgets to personalization (versus ~22% in 2023).”

[26]
Forrester: State of US Consumer Personalization, 2024 : Survey of US consumers on their experience of brand personalization efforts. Companies are increasing personalization investment while consumer satisfaction with those experiences remains flat or declining.

[27]
Medallia / Multiple Retail Sources, 2024 : Survey data on retail executive self-assessment of personalization capability. Cited via DemandSage and Contentful personalization statistics compilations, 2025.

Note on source quality: The majority of quantitative data in this brief originates from vendor-sponsored surveys (Optimizely, Twilio/Segment, Salesforce, Medallia, Adobe). While directional findings are consistent across studies, individual percentages should be treated as indicative rather than precise. Practitioner sources (CXL, VWO) skew toward companies already engaged with optimization, and may overstate industry maturity. All figures cited reflect 2024–2025 research unless otherwise noted.

© 2024 Fast Archer, LLC. All rights reserved.

© 2024 Fast Archer, LLC. All rights reserved.