What is an A/A Experiment?
A/A Experiments are experiments in which you test the Original page against an identical copy of itself, with the purpose of finding any issues with the setup or the platform that is being used for testing.
If the setup of the experiment is correct you should receive inconclusive results, and there should not be a winner declared.
After this experience is created and your setup verified, you can use it as a base for your A/B or Split URL Experiments.
It is good to also enable Google Analytics tracking on A/A experiment. This will foresee any differences between Convert and Google Analytics data.
What do I do if I get a winner?
If a winner is declared in your A/A test, you should check the setup of your experiment, to detect the inconsistencies on the measurement of your conversions.
*However, there may be a small portion of these type tests in which a false declaration may occur by pure chance, so please consider this."
How do I create one?
- Click on the Experiences menu item on the left side.
- Click on the "+ New Experience" on the upper right side.
- Fill out the details of the "Experience Creation Wizard", and select the "A/A Experiment" experience type.
After, this your A/A Experiment should be created. This will be identical to other types of experiments in the platform besides the difference that there are no options to "Edit Variations".
- Then you should Activate the experience by clicking Activate Experience button on the bottom left "Experience Summary" screen:
Get the Standard Conversion Rate of my Page
You can also use an A/A test to get the standard conversion rate of your page while using Convert. To do this, you should pause the variation of your experiment, and run the experience with the Original variation on. This will get you your standard conversion rate, that you can use for planning your future A/B test.
- Access your report by clicking on "Experiment Report" at the bottom left of your "Experience Summary" screen or by clicking on the experiment name on your "Experiences Overview".
- To pause the variation, you should hover on the variation row on the first table of the report near the "Conversion Rate" column. You will see different icons pop up. Select the one with the pause icon "II".