No results for ""
EXPAND ALL
  • Home
  • API docs

Holdouts

Read time: 1 minute
Last edited: Sep 11, 2024
Holdouts are only available with server-side SDKs

Holdout experiments are only available with server-side SDKs. You cannot use holdout experiments with client-side SDKs.

Overview

This topic introduces holdouts, which you can use to measure the effectiveness of your Experimentation program over time.

About holdouts

Holdouts let you exclude a percentage of your audience from your Experimentation program. After running a holdout for a set amount of time, such as a fiscal quarter, you can learn the overall effect of your experiments on the metrics you choose, and determine how effective the experiments you're running are.

The Holdouts list.
The Holdouts list.

Prerequisites

To use holdouts, you should understand the following concepts:

  • Experiment audiences
  • Randomization units
  • Analyzing experiment results by attribute

To learn how to create and manage holdouts, read Creating holdouts and Managing holdouts.

To learn how to build and run an example holdout, read Measuring Experimentation impact with holdouts.