Handle A/B Test (Set Cookies)

Almost every test you record with PreFlight will be successful first time - that’s our secret sauce. However sometimes, especially when you’re running A/B tests, our system can’t replicate being a user - because our bots get a different experience every time they view your website. This is usually a very easy fix.

With PreFlight you can set a cookie to force yourself to the control or the test (or test variant, if you’re fancy).

Take an example website that changes color each time the page is refreshed.

Now let's create a test that has a checkpoint for the word/color pink.

Once a test is created it will pass or fail depending on which route of the AB Test was randomly assigned. Now we need to make sure it takes the correct path when we run the test.

Go to the test details and click Advanced Editor.

Click on the first step. Usually Go To https://yourapp.... then enter your Cookie's name and value in the Set Cookies section

Make sure to click Save at the bottom right corner of the step!

Now run the test a few times to make sure it chooses the correct path every time. To do this quickly, select multiple browsers.

That's all! Let us know if you need any help