A/B testing is a powerful tool to make the most out of your campaigns. Below are the top best practices for marketers to follow for optimal results.
A/B testing in Mapp's Whiteboard is also available for Push Messages!
One thing at a time
For meaningful results, only test one variable at a time. For example, test different subject lines or different content layout. Don't try to test multiple variables in one sendout.
Make a testing plan
Example:
Month
Tests for Email channel
Test for Mobile Push channel
January
subject line and pre-header
action button
February
email blocks and hero banner
Content format (image or video)
March
call to action button
sound
April
product pricing (show/hide/font size), etc.
message text
Prioritize your tests
It’s not much use testing different call-to-action buttons if your open rates are low. Test the subject line first in this case!
Sample size
Ensure that the size of your test samples is sufficient. The more data points you get, the more reliable they are.
We recommend that you test the same element a number of times so you get more accurate and consistent test results.
Leverage existing data
Use existing statistics on Opens or Clicks to determine how many days should elapse before the main sendout. Make sure that enough time is allowed for the system to properly learn about recipient reactions.
Document what you do
Keep track of your tests, you won't remember all results!
Keep revisiting
What worked 12 months ago, may not work today, so challenge your sendouts and keep them fresh!
Cookie Notice
We use technically neccessary cookies. For details, please have a look at: mapp.com/privacy