A/B Testing of Notification is live with PushEngage

To get the best out of push notification, you need to create a proper push notification strategy. To support that, you can now use AB testing to know which notification works better and accordingly create notifications.

What Is AB Testing Of Notification?

At PushEngage, we constantly work to make the product feature-rich. We understand the importance of improving the push notification effectiveness for your business and so we have now updated our AB testing feature.

NOTE: A/B testing is only available on PushEngage for the Premium and Enterprise plans. If you’re already using PushEngage and you need to A/B test your notifications, please consider upgrading your account first.

This means you can do AB testing based on:

• Notifikationsindhold
• URL til landingsside
• Large Image & Notification Image
• Multi-Action Button
• Interaktionstyper

You can also put different UTM parameters for each of the notification. This way you can even track the performance using your own analytics tool like Google Analytics.

How AB Testing of Push Notification Works?

Using AB notification is very simple and straightforward. The AB test feature is available under the New Notification section. In the AB test notification, the number of subscribers is divided equally by the system. When you click on send, half of your subscribers will receive Notification A the other half will receive Notification B.

After a couple of hours, check the analytics to see which notification performed well. Based on the result, next time when you send the notification, follow the format of the winning notifications to get better results (more on this later).

This is how traditional A/B testing works. But after our April 2021 update, PushEngage now offers Intelligent A/B testing as an additional option. As the name suggests, Intelligent A/B testing will help you use your push notifications more effectively. 

Let’s take a quick look at how it works.

Intelligent A/B testing tests conduct the same test on a small percentage of your total audience. You can change the percentage to suit your needs, but the default setting sends the A/B test to 10% of your audience and then sends the notification that performs better to the remaining 90% of your audience automatically.

There’s no manual involvement here. PushEngage will do all this for you and all you have to do is set it up from the dashboard.

NOTE: You can’t A/B test an entire drip sequence. So, please use A/B testing to either understand your audience’s preferences better or use them only for broadcasts.

Basic Content of Notification

It will have all the details which users will see.

• Title Of the Notification
• Web Push Notification Message
• Notification Icon
• Large Image
• URL til landingsside

Notification Settings

In AB Test Notification, you can test notification interaction type:

• Keep open 20 seconds
• Keep notification open until an interaction

A/B Testing With PushEngage – 

Bedste praksis for A/B-test –

• Segmenter dine brugere baseret på deres demografi, købsmønster eller webstedsaktioner. Derefter kan du sende en A/B-testnotifikation. Det vil hjælpe dig med at opnå bedre resultater.
• Overbrug ikke A/B-test ved at bruge den før hver eneste kampagne.
• Planlæg at køre en test med et stort antal varianter, og sørg for, at du målretter mod et stort publikum. Det vil give dig bedre resultater.