Simon Muthusi

In the digital age, the difference between market leaders and those left behind often comes down to one thing: how quickly they can learn. Companies like Apple, Netflix, and Amazon have disrupted entire industries by treating their business plans as sets of hypotheses to be tested rather than fixed blueprints.

Redefining the Digital Product

To understand digital innovation, we must first define what a digital product is. Unlike traditional physical goods, a digital product is a tool or platform that can be created once and sold many times. This scalability is supported by a “Digital Stack” that differs from traditional business stacks in its technical and organizational flexibility.

While physical industries like construction and healthcare face more hurdles, they are increasingly adopting digital foundations through:

• Digital Twins: Creating virtual environments to build and test equipment before physical production.
• Digital Threads: Building communication frameworks that connect product data throughout its entire lifecycle.

What is Experimentation in Business?

Experimentation is more than just trying new things. It is a structured process of determining the consequences of novel dependencies among variables like customers, partners, and competitors. In a product context, experiments aim to validate hypotheses to improve speed, lower costs, or increase revenue.

Common Testing Methods:

• A/B Testing: A controlled experiment comparing two variants, A and B.
• Multivariate Testing: Testing more than two versions simultaneously to understand complex interactions.

The BEC Process: A Framework for Learning

The paper outlines a systematic approach to experimentation known as the BEC Process:

1. Identify Desired Outcome: For example, increasing long-term revenue.
2. State Association: Define the design variables (x) you want to change, such as font size.
3. Map to Associative Thread: Since long-term revenue is hard to measure quickly, identify a proxy variable (y), like “Dwell Time”.
4. Test Association: Set up the experiment to gather data.
5. Update & Analyze: Use the results to update your knowledge base and operational choices.

Design for Experimentation

Not all products are built to be tested. To drive innovation, digital products must be designed with certain principles in mind:

• Agile Development: Requirements and solutions should evolve through collaborative, cross-functional efforts.
• Modularity: Decomposing a design into smaller “modules” makes it easier to run small-loop experiments and counter the challenges of large-scale changes.
• Refactoring vs. Recomposition: Refactoring rearranges code to improve structure without changing behavior. Recomposition involves minimal behavior changes to support large-scale design shifts.

The “Countermeasure Mentality”

Innovation is not a one-time event. Inspired by the Toyota case study, successful experimenters adopt a countermeasure mentality. This means viewing every intervention as a short-term part of a continuous process of change and improvement.

In business experimentation, where total control is rarely possible, the goal isn’t necessarily to establish perfect causal relations but to find strong correlations that lead to better decision-making.

Full document can be read on https://drive.google.com/file/d/1kfZBrDMog-VlbcO_TflXhp-izYvJPKxY/view?usp=drive_link