What is the meaning of the confidence value you provide together with the results? How to interpret it?

Nelio A/B Testing for WordPress

The confidence value tells you how “trustable” is the fact that one alternative is better than the other/s.

A high confidence value tells you that you can be certain that choosing the best alternative is the best option to improve your conversion rate. A low confidence value means that with the current results, even if one alternative has so far a higher conversion rate than another, this could still be due to random effects so you have to interpret the results with caution.

We recommend waiting for at 90% confidence value in order to be sure to choose the best alternative.

The more visitors you have and the bigger is the observed difference between the alternatives, the higher is the confidence value.

Posted in: Statistics Antonio VillegasWhat is the meaning of the confidence value you provide together with the results? How to interpret it?