WordPress Split Testing Menus

Menus are one of the most important elements of a site. They organize all your pages and help your users browse through them. With Nelio A/B Testing, you will be able to choose the best menu structure you can use!

Easily duplicate your current menus, change them by adding new items, removing old ones, or rearranging them, and discover which menu helps your users browse your site better! No other A/B Testing plugin for WordPress makes these tests that easy!



Instructions for Split Testing Menus

Once you have installed, activated, and configured your A/B Testing Plugin, adhere to the following directions to begin split testing!

Create a New Experiment for Split Testing Menus

  1. Under the Nelio AB Testing menu, click Experiments to view and manage your experiments. Please note that the first time you access this page, you will not see any experiments.
  2. Three Different Ways to Begin:
    • If you have not yet defined any experiments, click the Create one now! link.
    • Click the Add New button placed beside the title, Experiments, in the upper left hand corner.
    • Under the Nelio AB Testing menu, click on the Add Experiment option.
  3.  You will now see a list with all the possible kind of experiments you can create. For each of them, you will see its name, an icon, and a description.
    • Click New Menu Test.

Setting Up Basic Information

Fill out the Basic Information of an Experiment. In this particular case, the basic information includes:

  • Name: a meaningful and descriptive name for the experiment that will help you identify it in the future.
  • Original Menu: the menu you want to test (note WordPress let’s you define more than one menu).
  • Description: any additional information about your experiment that will better help you identify it.

Create Alternative Menus

Create an Alternative Menu from Scratch

Under the Alternatives tab, click New Alternative Menu (empty) which will allow you to create a new menu from scratch.

  1. Name the alternative page beside Name (e.g. “Prioritize Pricing” or “List features as a submenu”).
  2. Click the Create button right below Name.
  3. Create as many menus as you want and then edit them using the Save Experiment and Edit Menu that appears below their names.

Duplicate an Existing Menu to Create Alternative Menus

Under the Alternatives tab, click New Alternative Menu (empty) which will allow you to create a new menu from scratch.

  1. Name the alternative page beside Name (e.g. “Prioritize Pricing” or “List features as a submenu”).
  2. Then, select the menu you want to duplicate beside Source.
  3. Click the Create button right below Name.
  4. Create as many menus as you want and then edit them using the Save Experiment and Edit Menu that appears below their names.

Edit the Alternative Menu

Editing alternative menus is extremely easy. Nelio uses WordPress’ regular menu editor, with just a few controls, for adding, removing, and restructuring your menus. No need to learn complex tools nor use shortcodes!

Goal Set Up

In order to define and configure which actions should be counted as conversions, go to the Goals tab. Actions are organized into Goals*. You may add additional Goals by clicking the Add Aditional Goal button. The first time you access this tab, you’ll see the Default, main goal. Actions are added as follows:

  1. Click on the New Action you want to create (for instance, if you want your users to view the Basic Package or the Professional Package page, add a new Page action).
  2. Configure the action properly (in our example, you’d have to select the Basic Package page, or the Professional Package, as well as any additional info required by the action*).
  3. Repeat the process for all the actions you need.

* For more information about how goals work and the available actions, check our Conversion Actions and Goals page.

Start Experiment

Once you have defined the experiment completely (that is, you defined the basic information, added one ore more alternatives, and organized one or more actions into goals), you may start the experiment. In order to do so, just go to the Experiments page, hover over the experiment you want to start, and click on Start to launch it.

* Please note that experiments cannot be edited once they’re running. You may edit the contents of the alternatives, even though this is not recommended. Changing the definition of an experiment while it’s running may impact on the performance of each alternative and, thus, invalidate the statistic results obtained.

Understanding Progress Information and Results

Find the Results of Your Experiment

Running experiments are shown in the Dashboard as simple cards where relevant information is shown. For this kind of experiments, the following information is available:

  • Page Views: how many times have your visitors viewed the tested page (either the original version or one of its alternatives).
  • Alternatives: number of alternatives defined in the experiment (original version included).
  • Original Version’s Conversion Rate: conversion rate of the original version.
  • Best Alternative’s Conversion Rate: among all the alternatives (original version excluded), it shows the highest conversion rate.

If you want to see more information about the Progress of the Experiment, either click on the experiment’s card in the Dashboard or go to the Experiments page, hover over the experiment, and click View.


General Information

The Progress of the Experiment page is organized in three different tabs. Each tab focuses on a different aspect of the test and provides the most valuable and relevant information related to that aspect.

The first tab is the General tab. There, you’ll find:

  1. Summary section, which shows the most relevant metrics of your running experiment:
    • Big Icon. The icon helps you identify the progress of the experiment quickly. If it’s red, then there’s either not enough data or none of the alternatives is better than the rest; if it’s yellow (with a clock on it), there’s a possible winner, but we’re not confident enough about the results; and if it’s blue (with a #1 badge on it), there’s a clear winner.
    • Conversion Rate of the Original Version. How your current version of the tested element is performing. This gives you an idea of your current conversion rate.
    • Best Alternative’s Conversion Rate. The percentage of times that visitors went to the designated goal page o post when shown the best alternative* (without including the original version).
  2. A Timeline of the conversion rate for the original and each alternative, as well as the total number of conversions and page views that the experiment has.
  3. Some metadata about your experiment. In particular, you can see the name and the description of the experiment, how long has it been running for, and the finalization mode (if any).
  4. Finally, you have two additional graphics showing the conversion rates of each alternatives and the improvements of each alternative with respect to the original version.

* The best alternative is defined as the alternative that has the higher percentage.


Details of the Experiment Alternatives

The second tab contains information about the Alternatives of your experiment. The alternatives include the original version of your tested element and all the variants you have created. For each alternative, you’ll have:

  1. Screenshot of the alternative (if available), so that you can see at a glance how it looks like.
  2. Information (both visual and textual) about the conversions, page views, and conversion rates of each alternative.
  3. A set of Quick Action Buttons:
    • View Content. Opens a preview of the selected alternative.
    • View Heatmap. It allows you to view the heatmap and clickmap for the page that is being tested.
    • Edit. It is shown when the experiment is running and allows you to modify the alternative.
    • Apply. It replaces the Edit link when the experiment is finished. It allows you to override the original page with the contents of the winning alternative.

Conversion Goals and Actions

The last tab contains information about the Conversion Actions of the selected goal. You can change the active goal using the “target” icon located at the upper-right corner of the user interface, next to the “Stop” button.

For each goal, you’ll see the list of all the conversion actions it contains. These conversion actions are organized depending on its type.

Take a look at our analytics page for reading more about about conversion actions and conversion goals.

David AguileraWordPress Split Testing Menus