Absolutely! Cache mechanisms are a real challenge for A/B testing. If we want to show an alternative to a visitor, we want to avoid WordPress caching the alternative and showing that same version to all visitors!
In order to overcome this particular problem, some A/B testing WordPress plugins are just not compatible with any caching mechanisms, and make you choose between performance and conversion optimization. Instead, our service makes sure cache plugins do their work by caching (if any) the original version of the page, and then replaces that content with the alternative one on the client side when necessary.
Posted in: Technical Aspects Is Nelio A/B testing compatible with cache plug-ins?