A/B testing upgraded: Test more things!

We’ve completely reengineered the A/B testing system to make it possible to test more variables.

You’ve long been able to test the page title and copy, as well as the appearance of (or lack of) a video or a thermometer on your contribution forms. Now, you can also test the pop-up recurring ask and title.

The best part? We’ve also added all of that testing data to the donor data .csvs, which are available for download on every form.

Here’s what it looks like. You’ll find it under the A/B Test tab when you’re logged in and editing a contribution form.

ABtestingtoolvisual

This new feature is best utilized by candidates and organizations that have thousands of donors contributing on one form. It’s unlikely that you’ll see statistical significance on these relatively small changes unless you have a large sample size.

For those of you that do have a large donor pool, you’ll be able to figure out which pop-up ask works the best for your program. For example, you can test offering a premium in the recurring upsell: “make it a recurring donation and you’ll get this awesome sticker.” And you’ll be able to track and fulfill those orders via the new .csv.

We’re really excited about this new feature because recurring contributions are so incredibly valuable to organizations and the pop-up recurring has proved to be such an easy way to convert people to recurring donations. Have fun testing and figuring out the best ways to build that recurring pool!

We’d love to know what you’ve been testing, especially if you’ve found clear winners and losers. And if you have questions about running A/B tests, please drop us a line at info@actblue.com. Our data analyst is more than happy to help you design and run a successful test.

2 Comments for “A/B testing upgraded: Test more things!”

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>