A/B testing

steve burleigh asked on August 20, 2015 14:40

Hi there

Im wondering if it's possible to do an A/B test on the main 'portal' page of a site running Kentico 8.2?

I wanted to test some theories around label names etc that appear in our header and footer areas on the site, and thought that an A/B test would be the best way to do this.

I've successfully setup some tests, but i cannot seem to get it to work on the portal page (apologies if I'm referring to it by the incorrect name). When following the devnet instructions, the options to create a new A/B test seem to be missing on this page (marketing module is running on the instance i'm using). Everything appears correctly under subsequent documents.

Be really grateful if someone could confirm if this is possible or not

Steve

ems ab testing

Recent Answers

Roman Hutnyk answered on August 21, 2015 05:27

Steve,

First of all A/B testing is recommended to use whenever you have two very different variants of the page, let's say two different templates.

If your variants will use the same page template, but different wording/styling it is recommended to use MVT testing.

If you have appropriate license it should be a matter of configurations. Have you checked this article in documentation?

0 votesVote for this answer Mark as a Correct answer

steve burleigh answered on August 21, 2015 10:12

Hi Roman

thanks for getting back to me.

I had wondered about using variants, but i couldnt see an obvious way of testing this - and also I don't want to set a condition for the changes.

Basically, I have a webpart on the footer of every page containing some links. We'd like to run a test to see whether or not not relabeling these links increases click thrus. Because this content sits on the main portal page, I'd been looking to establish whether or not I could do a split test on this template similar to 'standard' documents / templates.

If it's possible to run a 'split' test using variants, then this would resolve the issue, but I don't want to set a condition for people. I just want the page to serve up one set of links to 50% of users and another set to the other 50% regardless of their behaviour / status etc.

is this possible?

0 votesVote for this answer Mark as a Correct answer

Roman Hutnyk answered on August 21, 2015 15:52

As far as I know, yes, this is possible. System will show 1st variant to the 50% of viewers and 2nd variant to another 50%. The only thing is that if it showed 1st variant to you for the first time, it will show it to you all the time. I guess this is cookie based, so you might find and remove appropriate cookie to see other variant.

You can find more details on MVT here.

0 votesVote for this answer Mark as a Correct answer