QA Testing Your Experiments Before Putting Them Live

Video Explanation

Step by Step

The success of your experiments is firstly influenced by whether they are setup properly or not. Therefore a rigorous Quality Assurance (QA) process is needed before launching any new experiments.

There are several things that you can do to make sure your test will display and function properly:

  1. Do a live preview of your variations, which can be done also when your experiment has draft status.

    Make sure they render as expected in the most popular browsers for your business. Also make sure that any button, link,

    Also make sure that any button, link, or form still works well. (certain options in the editor could break forms, links and buttons if they are not used properly, see http://support.convert.com/hc/en-us/articles/205160385-Why-Are-My-Pages-Showing-Content-from-the-Page-Where-I-Set-Up-the-Experiment- . 

    Live previews work with a high accuracy but still there are cases when they can render unexpected results due to how technology works. It's advisable, that you always follow the point 2) below.

    To find out how to preview a variation, read the following article: https://convert.zendesk.com/hc/en-us/articles/204506649-How-Do-I-Preview-Variations-

  2. Place your experiment on "Active" status for a very specific audience that only you can meet the conditions for and therefore it will run just for you.

    To do that, you can use an "Advanced Audience" and build an audience rule similar to the following: "Medium matches exactly my_test". 

    You can replace "my_test" with whatever you like, just make sure you use that in audience rule.

Open a fresh incognito session on your browser. *This is very important.

Visit your site having the utm_medium query variable added with the value my_test (or whatever you used there).

Do this on the first page that you ask from the site. Even if you need to acces another page than the experiment page.

For example, if the URL is http://www.mysite.com, you should visit the URL: http://www.mysite.com?utm_medium=my_test

If you follow the above instructions you may be shown any variation of the experiment as this is selected randomly.

After you have done the above, you can just visit the experiment page and you should be viewing either Original, either one of the variations.

Force a specific variation

You can force a specific variation, by using certain query parameters to query it. For example:

Example: http://www.mysite.com/test-page.html?_conv_eforce=123.678 where 123 is the experiment ID and 678 is the variation ID;

You can find a more detailed explanation here .

Important
Important
Tip
Tip

If you are experiencing problems issues with click goals, please refer to this article for debugging

Have more questions? Submit a request

Comments