Using this functionality, you’ll create your own A/B testing to determine which subject lines, from field lines and content will perform best. This is article only covers the A/B testing outside of Marketing Automation.  If Automation is enabled for your account, read up on it here.

A/B Testing – also known as split testing – is an excellent way to improve opens and clicks. The premise is simple: Create multiple variables, send to random samplings of recipients and compare the results. Once deployed, you’ll have access to reports that compares the performance of your message.

To enable A/B Testing have your account’s admin contact Real Magnet’s Support Team.

Permissions

When enabling A/B Testing for your account, your account’s administrative user may determine that only certain users should be allowed to use this functionality. In order to send a split test a login must have the following permissions:

  • Send Message to Group
  • Create Groups

Creating A/B Tests

The first step is creating the test and selecting recipients for the test messages. This is completed once you select Send.  As with any message to a group you will need to first create a text only version.

  1. Select Send A/B Test
  2. Enter a descriptive name for your test i.e. Message Name Date Split Test.
  3. Select the type of testing you would like to complete:
    1. Same Message Different Subject Line: Select this option if you are testing different subject lines.
    2. Same Message Different From Field: Select this option if you are testing different from addresses.
    3. Different Messages: Select this option if recipients are receiving two different messages.
  4. Enter how many segments should be created. A segment is how many items will be tested. For example, if you will be testing two subject lines, you would enter 2. Or if you are testing three messages, you would enter 3.
  5. Click Submit.

Segmenting Groups

Once the main parameters of the test have been configured, your next step is to set up the list segmentation. Once you enter this stage you should not make changes to the segments and must avoid hitting the back button in your browser.  If any of these actions are taken, you must delete your A/B split test and begin the configuration phase again.

Sending the same message with different from field or subject lines

  1. Select your Source Group:  This in the main group where all of your recipients reside, this is the group from which the system will extract your random sample from.
  2. Select the Message you would like to test.
  3. Enter your sample size, you can either select a percentage or enter an actual number.
  4. Select to add the random sampling to a new group and enter a name that would be fairly descriptive.  If you have already split your groups and uploaded them to Real Magnet you may select those instead.
  5. If you have additional segments, repeat the steps above.
  6. Select Submit.

Sending different messages

  1. Select your Source Group:  This in the main group where all of your recipients reside, this is the group from which the system will extract your random sample from.
  2. Enter your sample size, you can either select a percentage or enter an actual number.
  3. Select to add the random sampling to a new group and enter a name that would be fairly descriptive.  If you have already split your groups and uploaded them to Real Magnet you may select those instead.
  4. Select the Message you would like to test.
  5. Select Submit.

Configuring your message details

The next and final step to the A/B split test is configuring the typical subject and from details, enter in the subject line and from addresses that you would like to test.  Note: Do not select any groups on this page.  Your groups have already been selected.  Once you have completed entering the details select Submit.

Comparing results

Once the messages have been sent, tracking data is collected by Real Magnet in the Track area.

  • Select Track A/B Testing.
  • Select the message you would like to track, double-click the message name or select Track.

The results will be displayed on the following page, broken down by message. At the top of the results for each message, you will see basic information to identify the message, including message name, subject line, from field and group name. The element that you designated for testing (i.e. subject line) will be displayed in red.

With these results, you can determine which elements performed best and use them to send the final message to the rest of the group recipients.