Experiment flags

Overview

This topic explains how you can use experiment flags to test a hypothesis. These flags help you validate the impact of features you roll out to your app or infrastructure.

About experiment flags

Experiment flags are temporary flags. In the most common use case, you wrap an experiment flag around code for a new or improved feature that impacts end users. Experiment flags can be either boolean or multivariate, so that the experiment can test multiple values. You can pair flags with metrics to compare context or system behavior between two or more flag variations. To learn more, read Experimentation.

Create experiment flags

To create an experiment flag:

1. Click Create and choose Flag. The "Create new flag" page appears.
2. Enter a unique, human-readable Name.
3. (Optional) Update the flag Key. You'll use this key to reference the flag in your code. A suggested key auto-populates from the name you enter, but you can customize it if you wish.
4. (Optional) Enter a Description of the flag. A brief, human-readable description helps your account members understand what the flag is for.
5. (Optional) Update the Maintainer for the flag.
6. (Optional) Check the Include flag in this project's release pipeline box. To learn more, read Release pipelines.
7. (Optional) Choose any Metrics to monitor in the Metrics section. To learn more, read Metrics.
8. Choose the Experiment flag template in the Configuration section:

9. Choose Yes or No to indicate whether this flag is temporary. Experiment flags are usually temporary.
10. Select a flag type:
    • Boolean: optionally update the Name of the true and false variations.
    • String: enter a Value for each variation, and optionally update the Name of each variation. To add more variations, click +Add variation.
    • Number: enter a Value for each variation, and optionally update the Name of each variation. To add more variations, click +Add variation.
    • JSON: enter a Value for each variation, and optionally update the Name of each variation. To add more variations, click +Add variation.
11. (Optional) In the "Variations" section, create variations for the control and each experiment treatment.
12. (Optional) Update the default variations.
13. Choose one or more tags from the Tags menu.
14. Check the SDKs using Mobile Key and/or SDKs using client-side ID boxes to indicate which client-side SDKs you will use to evaluate this flag. If you are using a server-side SDK, leave these boxes unchecked.
15. Click Create flag.

The new flag appears in the Flags list.

To learn more, read Creating new flags.

Then, run experiments on the flag. To get started, click Add experiment the flag's right sidebar. To learn more, read Creating experiments.

Modify the experiment flag template

To modify your experiment flag template:

1. Click the project dropdown. The project menu appears:

2. Select Project settings.
3. Select Flags. The Flags settings list appears.
4. In the "Flag templates section, click the pencil icon next to "Experiment."
5. In the "Tags" section, type to add tags to each new flag by default.
6. Click Save.

Verify that the updated default template settings are correct by navigating to the Flags list and creating a new experiment flag.