Was reading the responses on this question and started to wonder which was better Optimizely or Visual Website Optimizer, for A/B testing? Also curious about their differences, or if people have another vendor they like and would suggest?
I second Andrew. Too often the temptation is to jump to tools when the fundamental basics aren't right yet -- before you try to automate them at scale.
Once you have constructed your initial tests and have run them, you'll be in a better position to know what you need and what you want. Until then, questions about whether a solution such as Optimizely or Optimizer are better for you won't make much relevant sense.
Oblique answer, but I'd start off with a 3rd party common sense/heuristics
analysis, rather than worrying about product type.
All split tests are hard to do with low traffic and/or a bad starting
point, so it's best to get the friction out of the process first -
I tend to advise companies away from using tools for A/B testing until they have someone experienced with statistics in their shop. These tools, while helpful, readily allow their customers a way to go wrong with confidence.