Andreas Cederblad Δ
All articles
experimentation1 minFebruary 28, 2025

Why Most A/B Tests Don't Lead to Growth

Most companies test. Few grow from it. The problem isn't the tools — it's structure, prioritisation, and connection to business goals.

Most companies test. Few grow from it.

The problem

A/B testing is often seen as:

  • a tool
  • an activity
  • something you "do sometimes"

This leads to:

  • many tests
  • few insights
  • no direction

What's missing

What's missing isn't tools.

It's:

  • structure
  • prioritisation
  • connection to business goals

Without a clear measurement plan, you're testing blind.

Common mistakes

  1. Testing without a hypothesis — "Let's run a test" is not a strategy
  2. Measuring the wrong metrics — Clicks aren't conversions. Conversions aren't revenue.
  3. Stopping tests too early — Statistical significance requires patience
  4. No documentation — If nobody learns from the test, why did you run it?

That's the difference between activity and experimentation as a system.

What works

  • fewer tests
  • clearer hypotheses
  • connected to revenue

Every test should answer a question that moves the business forward. Not just "does blue or green work better."

That requires growth systems thinking — where every test is part of a larger process.

Conclusion

It's not the number of tests that drives growth. It's the quality of decisions.

Andreas Cederblad Δ