Getting Started Guide

Nelio A/B Testing for WordPress

Welcome to Nelio AB Testing for WordPress! We are very glad you are here. Please spend a few minutes going through this guide to learn some basics about our A/B Testing Service for WordPress. In this getting started guide you will learn how to:

  1. Link your WordPress site to your Nelio AB Testing account, so you can start AB-testing it.
  2. How to create, delete, and monitor the progress of page, post, and theme experiments.
  3. How to contact us from within the plugin, provided you encounter some problems or difficulties.

This guide assumes you have already installed and activated our plugin in your WordPress installation. If you have not, take a look at our installation guide!.

I have installed the plugin and activated the service. Now what?

After installing and activating the plugin, you will see that a new option called Nelio A/B Testing is available in the left column of your WordPress Dashboard.

Click this option, and you will see a welcome message, asking you to configure the plugin with your account information.

In order to use our service, you have to configure the Nelio A/B Testing plugin with your e-mail address and the Registration Number you received by e-mail after subscribing to one of our plans.

The first thing you have to do when accessing the Settings page is to introduce the required fields—i.e. your e-mail address and the product registration number.

Then, click the Access button to validate both fields. If everything is OK, you will now see your account information:

  • Your name and subscription type.
  • The remaining available quota.
  • The sites you registered to your account.

You’ll also notice a table in the end with (hopefully) one or more empty slots. This informs you of the WordPress sites that your account is related to. Click the Register it now button and you’ll be able to use the plugin in this site.

If you no longer want to use a registered WordPress site, just go to the My Account settings page in that site, place your mouse over the site’s name, and click Cancel Registration.

How do I manage my Experiments?

Under the Nelio AB Testing menu you will find and option called Experiments. Click it in order to view and manage your experiments.

Please note that the first time you access this page, you will see no experiments at all. Let’s take a look on how to create experiments! In order to create a new experiment:

  • Click the option called Add new experiment, under the Nelio AB Testing menu, or
  • from the Experiments page, click the Add new button placed beside the title, or
  • if you have not defined any experiments yet, click the Create one now! link.

Creating a new Experiment

With our plugin, you will be able to test different aspects of your WordPress site. In particular, you can:

  • test alternative headlines for a Post,
  • test one or more alternatives for a Page,
  • test one or more alternatives for a Post,
  • test one or more alternatives for a WooCommerce Product,
  • test one or more alternatives for a Custom Post Type,
  • test one or more alternative Themes among the installed themes,
  • test several Widget configurations,
  • test one or more alternative Menus,
  • test different CSS styles

and see which alternative works better.

Also, you can run a Heatmaps test to view which portions of a page are getting more attention from your visitors.

In the following, we’ll briefly discuss how to create a Page Experiment. If you need further details, please check the other tutorials.

Example: A/B Experiment for a Page

When creating an experiment in Nelio A/B Testing, the first thing you have to do is provide some Basic Information about it:

  • Name: a meaningful and descriptive name for the test that will help you identify it in the future.
  • Description: any additional information you want to include about your experiment.
  • Original Page: the page (or post) for which you will create different alternatives—e.g. your landing page.

After you have introduced the basic information, it is time to create one or more alternatives for the Original Page. Go to the Alternatives section by clicking the Next button.

This section summarizes the alternatives this experiment has. In order to create new alternatives, simply click to either the New Empty Alternative (empty) button or the New Alternative (based on an existing page button. These buttons will open a new dialog* where you can name the alternative (e.g. “Single Action Button” or “Blueish Landing Image“).

* When creating an alternative “based on an existing page”, the dialog will let you select the page whose title, content, and metadata are to be copied.

After you have created one or more alternatives, you can edit them. In order to do so, just place your mouse over the alternative’s name and click Save Experiment & Edit Content. This will open the regular WordPress editor for Pages and Posts. You’ll be able to move back and forward to edit each alternative.

Finally, you can define which actions have to take your users to be computed as conversions. In order to do so, go to the Goals section by clicking the Next button.

This section shows the set of Actions that will count as a conversion, organized into Conversion Goals. You can add as many goals as you want by clicking the button Add New. For each goal, you can define which actions can take the user to fulfill it and count as a conversion. There are different type of actions (accessing a page, submitting a form)… select those that are relevant to your experiment and you’re done!

Running and Monitoring Experiments

When the experiment is finally ready (i.e. it has one or more alternatives available, the goal page defined, and so on), you will be able to start it. In order to do so, just place your mouse above the name of the experiment in the Experiments page and click the Start button.

Understanding the Progress Information of my Experiments

Running experiments are shown in the Dashboard as simple cards where relevant information is shown. For this kind of experiments, the following information is available:

  • Page Views: how many times have your visitors viewed the tested page (either the original version or one of its alternatives).
  • Alternatives: number of alternatives defined in the experiment (original version included).
  • Original Version’s Conversion Rate: conversion rate of the original version.
  • Best Alternative’s Conversion Rate: among all the alternatives (original version excluded), it shows the highest conversion rate.

If you want to see more information about the Progress of the Experiment, either click on the experiment’s card in the Dashboard or go to the Experiments page, hover over the experiment, and click View.

The Progress of the Experiment page is organized in three different tabs. Each tab focuses on a different aspect of the test and provides the most valuable and relevant information related to that aspect.

The first tab is the General tab. There, you’ll find:

  1. Summary section, which shows the most relevant metrics of your running experiment:
    • Big Icon. The icon helps you identify the progress of the experiment quickly. If it’s red, then there’s either not enough data or none of the alternatives is better than the rest; if it’s yellow (with a clock on it), there’s a possible winner, but we’re not confident enough about the results; and if it’s blue (with a #1 badge on it), there’s a clear winner.
    • Conversion Rate of the Original Version. How your current version of the tested element is performing. This gives you an idea of your current conversion rate.
    • Best Alternative’s Conversion Rate. The percentage of times that visitors went to the designated goal page o post when shown the best alternative* (without including the original version).
  2. A Timeline of the conversion rate for the original and each alternative, as well as the total number of conversions and page views that the experiment has.
  3. Some metadata about your experiment. In particular, you can see the name and the description of the experiment, how long has it been running for, and the finalization mode (if any).
  4. Finally, you have two additional graphics showing the conversion rates of each alternatives and the improvements of each alternative with respect to the original version.

* The best alternative is defined as the alternative that has the higher percentage.

The second tab contains information about the Alternatives of your experiment. The alternatives include the original version of your tested element and all the variants you have created. For each alternative, you’ll have:

  1. Screenshot of the alternative (if available), so that you can see at a glance how it looks like.
  2. Information (both visual and textual) about the conversions, page views, and conversion rates of each alternative.
  3. A set of Quick Action Buttons:
    • View Content. Opens a preview of the selected alternative.
    • View Heatmap. It allows you to view the heatmap and clickmap for the page that is being tested.
    • Edit. It is shown when the experiment is running and allows you to modify the alternative.
    • Apply. It replaces the Edit link when the experiment is finished. It allows you to override the original page with the contents of the winning alternative.

The last tab contains information about the Conversion Actions of the selected goal. You can change the active goal using the “target” icon located at the upper-right corner of the user interface, next to the “Stop” button.

For each goal, you’ll see the list of all the conversion actions it contains. These conversion actions are organized depending on its type.

Take a look at our analytics page for reading more about about conversion actions and conversion goals.

Antonio VillegasGetting Started Guide