What is it?
Value Performance analyzes the individual changes within an experiment to let you know if they contributed towards an uplift, or negatively impacted your site.
Why would I use it?
- Gain deeper insight from your tests
- Understanding the ideas driving change on your page
- More information to tell a fuller story of how the experiment went
- Build up transferable learnings to take into future testing
Where can I find it?
On the main report page, you will find the value performance data underneath the candidate graph.
We have 2 approaches for calculating a value's performance - our team will work with you to identify which is most appropriate
This approach uses linear modeling to calculate the expected performance of an individual change.
- It provides an expected relative uplift value for the change
- It doesn't (yet) take into account interaction effects between values
Note: As this approach uses a different methodology to evolution, and doesn't take interactions into account, it can sometimes give results that don't match the values promoted by evolution
This approach reports on the interaction of these changes during evolution - showing which changes evolution promoted. It does this by analyzing how commonly changes appear in the best candidates.
- As it reports on the behavior of evolution, the effect of interactions between the values
- It ranks the values but does not provide a prediction on whether or not the change is positive or negative