Historical results for frequentist experiments

Overview

This topic explains how to read and use the Historical results tab of a frequentist experiment.

The Historical results tab lets you see a variation's performance over time. You can view a variation's Relative difference from Control and its Conversion rate.

Relative difference from Control

Click Relative difference from Control to view flag variation relative differences from the control over time.

The relative difference from the control variation is the difference between the treatment variation's conversion rate and the control variation's conversion rate. Hover on any point of the chart to view the relative difference from control and the 95% confidence interval for each variation tested.

Conversion rate

Click Conversion rate to view flag variation conversion rates over time.

The conversion rate is:

• for binary metrics, the percentage of contexts that triggered at least one conversion event
• for count metrics, the total number of times a context triggered a conversion

The conversion rate displays for conversion metrics only.

Mean

Click Mean to view flag variation means over time. The mean is a variation's average numeric value that you should expect based on the data collected so far.

The mean displays for numeric metrics only.