Startups · A/B testing

Optimizely vs. Visual Website Optimizer for A/B testing?

Eleanor Carman Incoming BLP Sales Associate at LinkedIn

June 10th, 2015

Was reading the responses on this question and started to wonder which was better Optimizely or Visual Website Optimizer, for A/B testing? Also curious about their differences, or if people have another vendor they like and would suggest?  

Greg Sherwin vp engineering + it • singularity university

June 11th, 2015

I second Andrew. Too often the temptation is to jump to tools when the fundamental basics aren't right yet -- before you try to automate them at scale.

Once you have constructed your initial tests and have run them, you'll be in a better position to know what you need and what you want. Until then, questions about whether a solution such as Optimizely or Optimizer are better for you won't make much relevant sense.

Andrew Lockley Investments & consulting for tech startups

June 10th, 2015

Oblique answer, but I'd start off with a 3rd party common sense/heuristics analysis, rather than worrying about product type. All split tests are hard to do with low traffic and/or a bad starting point, so it's best to get the friction out of the process first - manually. Andrew Lockley

Shea Valentine Data Science Lead

August 11th, 2016

I tend to advise companies away from using tools for A/B testing until they have someone experienced with statistics in their shop.  These tools, while helpful, readily allow their customers a way to go wrong with confidence.