The Quick and Dirty Guide to A/B Testing Your Donation Page

first_imgYour landing pages are important, and your donation pages are no exception. Do you ever wish you could know which messages, suggested donation amounts, or photos are the best at inspiring your donors to give?Enter A/B testing.Although testing might seem a little scary if you’ve not done it, there are simple tests you can perform to ensure you’re getting the most out of your online donation pages. Basic A/B testing helps you decide which images, calls to action, and suggested donation amounts perform best Basic A/B testing helps you decide which images, calls to action, and suggested donation amounts perform best by comparing the effectiveness of two versions of your donation page.Here’s how it works: a randomly selected half of your audience is served one form (the control), and the other half gets another form (the test). The test version has just one variable changed: the layout, image, copy, or headings.Over time, monitor which donation page has the higher completion rate, calculated as follows: number of donations divided by the number of people who landed on your page.Not so scary after all, right? Here’s a simple step-by-step guide from my friend (and super-smart fundraising pro) Alia McKee of Sea Change Strategies:Set up a control donation page.Decide which variable you want to test (see “What to Test” below).Set up a second donation page with that variable changed.Make both pages live and drive traffic to both forms. (You can split your email list and include a different page in each email.)Track completion rates across both pages, calculated by the number of donations divided by the number of people who landed on the form.Monitor your results (depending on the traffic to your pages, your test may need to run for a longer period of time).Check your results with a statistical significance calculator like this one.*The winner of this test becomes your control.Now, start the process all over again to get even smarter. Test another variable against your new control to learn what elements improve your conversion rate and lead to more donations.* What’s a statistically significant result? This just means that you can rest assured that your results did not occur purely by chance.When to TestThe best time to test is when you think you’ll get a significant amount of traffic to your donation page. These moments might include:A specific email campaign.In December, when a majority of online giving occurs.A high-profile event or during media attentionHigher traffic volumes mean you’ll have a better chance that you will get statistically significant results. If you have low traffic volume, you must test for a longer period of time to get significant results.What to TestSo, what should you test? Here are a few ideas that typically yield useful insights:Photos: Does a puppy beat a kitten?Layout: Does a one-column form beat a two-column form?Testimonials: Does a testimonial from another donor increase completion rates?Donation amounts: Does a lower suggested donation amount increase completion rates?Copy: Does shorter intro copy beat longer intro copy?Premiums: Will offering a thank you gift increase completions?What Not to TestOn the flip side, there are a few things that aren’t worth the effort. Here are a few tests you can avoid:More than one variable at a time: you won’t know which element made the difference.Elements that are outside your nonprofit’s branding: this different experience will likely cause donors to be confused, affecting your completion rates.Images that are too similar: it’s unlikely this will have significant results, and therefore not worth your time.Copy that is too similar in tone and length: your donors likely won’t notice the nuance.How to Read Your ResultsAfter a period of time, run your results through the significance calculator. If you have statistically significant results, you can name the winner and move on to another test.If you don’t have a statistically significant winner, keep the test live for few more weeks to collect more data.If you still don’t have a statistically significant winner (and this sometimes happens), try testing a different variable. Now is the time to start thinking about testing your pages, if you’re not in the habit of doing so already. If you can work in a few tests in the next few months, you’ll be in prime shape to greet an onslaught of donors come December. What do you plan to test? Let me know what you’re testing in the comments and share your results!Want more tips on improving your donation pages? Grab a copy of the Ultimate Donation Page Guide!last_img