• HOME
  • INTEGRATIONS
  • SDK
  • API DOCS
No results for ""
EXPAND ALL
CLOSE
launchdarkly.com

EDIT ON GITHUB

Controlling experiment populations

Read time: 2 minutes
Last edited: Feb 3, 2020

Overview

This topic explains what an experiment population is, and how to use LaunchDarkly's features to show experiments only to a specific group of users.

Understanding experiment populations

You can get accurate results more quickly if you only expose some of your user base to experiments. You have the option to only include a subset of users in your experiments. This subset of users is referred to as your experiment population.

You can create a custom experiment population by selecting specific flag targeting rules to include in your active experiments.

For example, imagine you are testing alternate copy for your checkout button. You're currently targeting all your Canadian and US users with the 'true' variation for the alternate button, which shows your new copy, but you only want to run an experiment measuring click conversions for users in the United States. To accomplish this, you select the user targeting rule that affects US-based users and de-select the rule that targets users in Canada.

You may want to refine your experiment population for any of the following reasons:

  1. Running targeted experiments for a subset of your flag-targeted users.
  2. Excluding user groups whose events you do not need to measure. For example, users affected by 'Default' rules.
  3. Reducing the events volume an experiment generates in order to manage billing costs.
Can't see the "Configure event settings" options?

If you can't see the feature described below, your SDKs may be out of date. To solve this problem:

  1. Update your SDKs to the latest version.

  2. Contact support@launchdarkly.com to enable the feature.

Customizing experiment population

You can refine your user base into a specific experiment population by following the procedure below.

Customizing events for Data Export

You can also configure which user data LaunchDarkly sends to Data Export destinations in this menu. Customizing which data LaunchDarkly exports.

To customize your experiment population:

  1. Identify which flag is associated with the experiment you wish to modify.
  2. Navigate to that flag's Settings tab.
  3. Click N of N targeting rules in the "Exporting events from" line. The "Configure event settings" screen opens.

A flag's Settings page with the targeting rules link called out.
A flag's Settings page with the targeting rules link called out.

  1. Click the Custom selection radio box to modify the users who can see an experiment. When you click Custom selection, you can choose which targeting rules you wish to include or exclude from an experiment.
  2. Select the checkboxes of rules you wish to include in the experiment. This refines the experiment's population down to the group you choose.

The "Configure event settings" menu with some targeting rules selected.
The "Configure event settings" menu with some targeting rules selected.

  1. Click Save Changes. A confirmation modal appears.
  2. Type the name or key of the environment in the text box and click Confirm.

The modified list of users you created is now the experiment's population.

Experiment populations do not affect flag targeting rules

You can customize your experiment's population at will without your flag targeting rules changing. Flag targeting controls which variation of a flag a user sees. An experiment's population determines which of your users contribute to experimentation results or data export streams. To learn more, read Targeting users.