Test Report Graphs

Understand Test Report Graphs

In Convert Experiments, you can add multiple  goals to get better perspective on performance of variations. You get an overview of the tests in the summary of the experiment. This table shows each variations' performance for each goal. Conversions and visitors are all measured in unique visitors. See screenshot below:

summary.png

When hovering over the variation row you get the options (icons) to:

  • Preview the variation in a new window
  • Change the baseline
  • Pause or start a variation

Stabilized or Cumulative Graph

To get a clear view on the trends in an experiments we supply each report with a cumulative or stabilized graph. The way to change between the two you will find in the options icon top right of the report (see screenshot below).



That is, a graph where visitors and conversions on a particular day has visitors and conversions added for all previous days. The stabilized view gives a sum of the previous days in the graph to get a clear idea what test is winning. See the graph below in this screenshot:

Day-Wise Graph

Convert Experiments has a day-wise charts in the test reports which show conversion rate for variations for different days (during the time test is running). The conversion rate can fluctuate for different days based on various factors like weekdays or weekend or low traffic days, this graph is harder to interpret then the stabilized graph. Like the stabilized graph you will find gray areas that represent the weekends. Take a look at example of a day-wise chart below:

 

Full Report View

The full report view gives a screenshot of each variation and when hovering over the screenshot the options to:

  • Change the baseline
  • Retake screenshot
  • Open full screenshot in new windows
  • Cross browser testing
  • Pause or start a variation
  • Preview the variation in a new window

The full report gives an overview of each variation by goal and look like the screenshot below:

full-report.png

Have more questions? Submit a request

Comments