A/B testing upgraded: Test more things!

We’ve completely reengineered the A/B testing system to make it possible to test more variables.

You’ve long been able to test the page title and copy, as well as the appearance of (or lack of) a video or a thermometer on your contribution forms. Now, you can also test the pop-up recurring ask and title.

The best part? We’ve also added all of that testing data to the donor data .csvs, which are available for download on every form.

Here’s what it looks like. You’ll find it under the A/B Test tab when you’re logged in and editing a contribution form.

ABtestingtoolvisual

This new feature is best utilized by candidates and organizations that have thousands of donors contributing on one form. It’s unlikely that you’ll see statistical significance on these relatively small changes unless you have a large sample size.

For those of you that do have a large donor pool, you’ll be able to figure out which pop-up ask works the best for your program. For example, you can test offering a premium in the recurring upsell: “make it a recurring donation and you’ll get this awesome sticker.” And you’ll be able to track and fulfill those orders via the new .csv.

We’re really excited about this new feature because recurring contributions are so incredibly valuable to organizations and the pop-up recurring has proved to be such an easy way to convert people to recurring donations. Have fun testing and figuring out the best ways to build that recurring pool!

We’d love to know what you’ve been testing, especially if you’ve found clear winners and losers. And if you have questions about running A/B tests, please drop us a line at info@actblue.com. Our data analyst is more than happy to help you design and run a successful test.

2 comments
  1. Ummm, why not just partner with Optimizely. Nonetheless this is a smart move!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Follow

Get every new post delivered to your Inbox.

Join 34 other followers

%d bloggers like this: