How to Experiment with New Ideas Using a Trial Program, Part III

In the first part of this series, you explored the benefits of using experimentation to discover new solutions for old problems. In the second part of this series, you learned some best practices around rolling out a trial program and soliciting feedback. In this third and final part of the series, you find out about taking action and turning your trial into a full-out launch.

Making a case for a full-out launch

If your trial isn’t successful, you can still gain value from the experience. In fact, you may walk away with some useful lessons about member behavior. Also, you have worked on promoting problem-solving in a way that was different than the status quo.

Alternatively, if your experiment was successful, it’s time to report your success and get the approval to roll out your idea, product, or solution to the entire membership. Include the following when preparing your case:

  • Goals you met according to the metrics you chose. 
  • Milestones you were able to reach and how.
  • Participant feedback and testimonials.
  • Comparisons to the norms. For example, the typical newsletter open rate vs. trial open rate.
  • Outcomes and predictions. For instance, being able to tell clients to expect a continued increase in open and click rates with the collection of more behavioral data.

The success of your trial program will be even more impressive when you can tie it to organizational goals, opportunities, and revenue. For example, provides opportunities to generate revenue from advertising and sponsored content.

Tweaking the program

During a trial, you will discover many new things about user behavior. Most importantly, you will learn whether or not your program provides enough value for members to continue using it. Also, you will find out how to improve the program. For example, in the case of trials, we can decide to tweak several features according to user behavior, including:

  • News brief content sources
  • Terms to include or not in AI searches for content
  • Featured content from the association
  • Time spent
  • Template style
  • Subject lines
  • Footer information

You should address any issues and make the final changes before launching the program. If you’re working with a partner, be sure you know who’s responsible for what. In the case of, we do the heavy-lifting, so implementation takes hardly any time for the association. Also, if the trial went as well as you expected, all we have to do is add new names to your distribution list.

Preparing for the launch

Remember, trial or pilot participants are your program champions when it’s time to turn your experiment into a reality. So keep them informed and engaged and they can help you get members excited about this new benefit. They might even put in a word with decision-makers if you’re having trouble getting approval for the program.

Be sure to thank participants publicly for their time and insight. Show your gratitude by referring to them as advisors or a similar title in all your program marketing materials. When rolling out the program to membership, follow the same onboarding practices you used for the trial group. Be sure to bolster your communication with testimonials from trial participants.

It’s important to share the story of how you wanted to solve old problems with innovative, new solutions. Your members will appreciate the value that the new insights, practices, or technology will add to their membership.

A retrospective on the process

Before you move on to the next project on your list, take time to do a project retrospective. Document how you went through the process and note areas of success and areas that need improvement. You can use this experience as a template for future pilots and projects as well as a case for continuing to promote innovation in your association.

Trial or pilot programs let you experiment on a small scale to discover solutions for big problems. One of the biggest problems all associations share is finding a way to bridge the member engagement gap. The engagement gap is the span of time between a member’s infrequent interactions with your association. Our association partners are using on both a trial and permanent basis to help them deliver regular value to members and to ultimately solve the engagement gap challenge.

Experimentation with

By harnessing artificial intelligence to find and deliver personalized content to every single member in a daily or weekly newsbrief, bridges the engagement gap. Members eagerly anticipate these emails because they’re crafted just for them. Over time, as a member interacts with the news brief,’s AI engine learns more about their interests, behaviors, and personality, helping their content continue to intelligently evolve.

If your association has an “unsolvable” big problem, consider running a trial program to experiment with a new solution, technology, process, or program. Taking a small calculated risk like a trial program will help build a culture of experimentation while revealing new ways for your members to build an association habit. Are you interested in experimenting with new ways to engage your members? Learn about how can help.

This blog is the final in a three-part series on experimentation. Read the first part of this series on the benefits of experimentation and the second part of this series about rolling out a trial program.

Our users love to brag about the growth of their businesses.

Start seeing better results by sending better emails.

Read more from the Pushing Send Blog!

Is Marketing AI Taking Jobs

Is Marketing AI Taking Jobs?

Artificial Intelligence (AI) is a powerful tool that is rapidly transforming many industries, including marketing. Some people are concerned that...

Read More

Event Email Marketing Strategy: All You Need to Know

You have an idea for an event, but how do you get people to attend it?  If you already have an email list, incorporating event email marketing into your communication strategy is an excellent start. You can use promotional emails, email newsletters, or drip...

Read More

Is Marketing AI Taking Jobs

Is Marketing AI Taking Jobs?

Artificial Intelligence (AI) is a powerful tool that is rapidly transforming many industries, including marketing. Some people are concerned that AI is taking over jobs and will eventually lead to widespread employment cuts in the marketing industry, which is...

Read More

The Newsletter Naming Blueprint

The Newsletter Naming Blueprint: Steps to Success

In the ever-evolving world of email marketing, where newsletters are the linchpin connecting brands with their audiences, the art of naming these digital publications stands as a critical and often underestimated facet of success. This article takes you on an...

Read More

How to Choose the Right Email Newsletter Image Size

How to Choose the Right Email Newsletter Image Size

It is an indisputable fact that email newsletters have become the lifeblood of many organizations and associations, particularly when it comes to engaging members and continuing to foster growth. For example, Nonprofit Tech for Good, a digital marketing and...

Read More

AI in Media and Publishing A New Era of Transformation

AI in Media and Publishing: A New Era of Transformation

Artificial intelligence (AI) is transforming the media and publishing industry in many new and exciting ways. From automating mundane tasks to personalizing reader experiences and uncovering deep insights, AI is poised to become a potent catalyst for industry...

Read More