**NEW** Ascend Experiment Reporting Enhancements

 

Sentient Ascend is glad to announce upgraded experiment reporting features, functionality, and user experience. Reporting enhancements are now available for all customers. See details and benefits below.

Feature Benefits

Reporting that helps you focus on the most valuable information you need to know.

Important Experiment Dates

  • Easily view comprehensive experiment timeline, and narrow timeline focus using timeline sliders below each graph.

Focus on Uplift

  • Candidate and time series graphs show the difference from control, resulting in a clearer performance representation relative to control.
  • Control can be toggled back in to identify unusual behavior.

Information Drill Down

  • Time series graphs for individual candidates are now available.
  • Visitor and conversion data can easily be exported.

Spot Unusual Traffic

  • Daily visitors are displayed so that abrupt changes in experiment performance can easily be correlated to significant changes in traffic.

Top Performer

  • Highlights the best performing candidate at any given time.

Enhanced Reporting Overview

 

Top Performer

  • The candidate with the greatest % improvement above control – where control is calculated over the same lifetime as the candidate it is being compared to.
  • At any point of time during an experiment, of all the candidates tested, the top performer is outperforming control by the most.

Start Date

  • Elapsed time since the beginning of the experiment.

Total Visitors

  • Number of distinct visitors who are involved in the experiment, including control.

Unique Daily Visitors

  • Number of distinct visitors per day who are involved in an experiment, including control. A returning visitor is not counted again – they are only counted on the first day they are seen.

Conversion Rate Comparison Selector

Open_dropdown.png

What is it?

  • A dropdown selector shows the conversion rates of individual and groupings of candidates.
  • There are grouped selections for 'All Candidates' (all candidates that have ever been used), and 'Active Candidates' (candidates currently being allocated to new users in the experiment), ordered by relative improvement.
  • Selecting one of these from the dropdown will update the candidate graph and time series.

Candidates Graph

What is it?

  • A visualization of each candidate plotted against its control conversion. Sortable by improvement from control, or sequence number.
  • A candidate will be displayed as green when the bottom of the error bars is above the top of the control's error bars.

How is it calculated?

  • Each candidate's control is calculated individually against the appropriate time period the candidate was running over.

Candidate Details

What is it?

  • Extra information on the candidate including: absolute lift above control, relative (%) lift above control, total conversions, and the generation the candidate belongs to. Shown when the candidate is selected in the dropdown, or on hover.

candidate_image.png

How is it calculated?

  • Each candidate's control is calculated individually against the appropriate time period the candidate was running over.

 

Time Series Chart

What is it?

  • The time series is cumulative conversion rate of the selected data in the comparison selector. Confidence intervals are displayed for the selection and its control. Hovering over a date reveals candidate information about the chart at that time.
  • Conversions are attributed to the day the visitor first converted, and the date an experiment or candidate was ended, (for a candidate this means we stop allocating traffic to it), is marked on the chart.

 

How is it calculated?

  • The control time series is taken as visitors are allocated the control candidate over the time period the selected candidate or candidates were active for. 
  • The conversion rate is the mean of the of the visitors allocated to the candidate. 

Hover Details

Hovering over the time series or candidates graph will display the absolute, relative uplift and total conversion for that date. Conversions are attributed to the day the visitor first converted.

Cumulative_Results.webp

 

Have more questions? Submit a request

0 Comments

Please sign in to leave a comment.
Powered by Zendesk