The Tracking page for A/B Testing campaigns will show you live results while the campaign is running, and then final results after the evaluation time has passed.
The Salesforce Integration Options page has three sections for preferences.

Opening the Tracking Page

Using the Tracking Page

Winner by Open/Click Rate

Samples Comparison

Winner Funnel

Winner Daily Engagement

.

Opening the Tracking Page

To view the Tracking page for an A/B campaign, you can either:

  1. On the Campaign Management page, single-click the campaign you would like to track. Then, click the Track button.
  2. When editing the campaign, click the Track Campaign link in the left-hand sidebar.

.

Using the Tracking Page

.

Winner by Open/Click Rate

The left side of this report shows you which test message won according to the criteria you set for the campaign.

  • If it is still before the date and time you set for a winner to be determined, the report will show a current winner.
  • If no test message won, or if there is no current winner, the report will say “no winner.”

The right side of this report shows you a bar graph with the open or click rate for each test message, depending on whether you chose open rate or click rate as the winning condition for the test.
.

Samples Comparison

This report compares the delivery statistics for the test messages sent to each sample.

  • Choose by number to see the total number for each column.
  • Choose by percentageto see the total number of sent messages, with the other columns as a percentage of that value.

Sent shows the number of test messages sent.

Delivered shows the number of messages successfully delivered to the recipient.

Opened shows the number of messages opened by the recipient. It is possible for this number to be higher than the number of deliveries, because a recipient can forward the message to another recipient.

Clicked shows the number of links clicked by the recipient.

  • It is possible for this number to be higher than the number of opens, because the same recipient can click a link multiple times, or they can forward the message to another recipient, who can also click the link,

Bounced shows the number of attempted deliveries which failed.

  • If the message bounced because Real Magnet did not receive a message receipt, it can take a few hours for the bounce to be counted. This is because Marketing Automation will wait to see if the recipient’s mailbox was just slow in accepting the message before counting that message as bounced.

.

Winner Funnel

This report shows where each campaign member is as part of your classic marketing funnel for the winning message. It tracks the results for the winning message after it is sent to the remainder of the recipients.

  • It does not include messages sent before the evaluation date and time.
  • If the winner has not been sent to the remainder yet, this report will be blank.

Sent shows the number of messages sent.

Delivered shows the number of messages successfully delivered to the recipient.

Opened shows the number of messages opened by the recipient.

  • It is possible for this number to be higher than the number of deliveries, because a recipient can forward the message to another recipient.

Clicked shows the number of links clicked by the recipient.

  • It is possible for this number to be higher than the number of opens, because the same recipient can click a link multiple times, or they can forward the message to another recipient, who can also click the link.

.

Winner Daily Engagement

This chart displays the “rolling” engagement rate for both opens and clicks for the winning message of the A/B test, when the winning message is sent to the remaining campaign members.

  • It does not include messages sent before the evaluation date and time.
  • If the winner has not been sent to the remainder yet, this report will be blank.

The data is calculated as follows:

  • total number of opens/total number of delivered
  • total number of clicks/total number of delivered

Example

  1. On day 1, you send out 50 messages to sample A, and 50 messages to sample B.
  2. In sample A, 7 recipients open the message, and in sample B, 3 recipients open the message.
  3. The total number of messages sent is 100, and the total number of opens is 10, so the open rate would be 10%.
  4. The next day you do NOT send any additional messages, but another 2 recipients in sample B open the message.  The open rate would then increase to 12%.

Each campaign member gets one opportunity to engage with each message (multiple opens and clicks of the same message by the same campaign member are only counted once.)