June 28, 2024

How to Make Sure Your Pilot Project Leads to Sustainable Funding - Episode 53

How to Make Sure Your Pilot Project Leads to Sustainable Funding - Episode 53
How to Make Sure Your Pilot Project Leads to Sustainable Funding - Episode 53
The Nonprofit Power Podcast
How to Make Sure Your Pilot Project Leads to Sustainable Funding - Episode 53

Pilots can be a great strategy for setting the stage for sustainable funding. Many nonprofits have successfully leveraged a pilot project to unlock millions of dollars in funding and to achieve key policy changes that ensure those services are always available going forward. But too many pilot projects end with no discernible impact on funding or policy. And that's a shame because it doesn't have to be that way.

The truth is if a nonprofit makes one or more key mistakes when setting up the pilot, it'll probably fail to generate meaningful change. But with proper strategic design, you can dramatically increase your chances of turning a pilot project into long-term funding and policy gains. But it only works if we set it up to successfully prove the case for investment.

In this episode, we share:

  • The fundamental thing decisionmakers need to know from your pilot
  • The four major mistakes that can doom your pilot project
  • How to define success for the three most critical entities in your project
  • The two keys to getting impactful data from your pilot
  • How to get the full engagement and cooperation of all partners in the pilot
  • The biggest danger to your organization, and how to avoid this common trap inherent in pilot projects

Links:
Episode 09 - How to Get Decisionmakers to Pay Top Dollar for Your Organization's Services

If you found value in this episode, please share it with other progressive nonprofit leaders. And I’d be grateful if you would leave a rating and review on Apple podcasts, which will help even more people find out about this podcast.

Thanks!


0:00 You're listening to the Nonprofit Power Podcast. In today's episode, we share how to make sure your pilot project leads to sustainable funding. So stay tuned. If you want to have real and powerful influence over the money and policy decisions that impact your organization and the people you serve, then you're in the right place. I'm Kath Patrick and I've helped dozens of progressive nonprofit leaders take their organizations to new and higher levels of impact and success by building powerful influence with the decision makers that matter. It is possible to get a critical mass of the money and policy decision makers in your world to be as invested in your success as you are.

0:48 To have them seeking you out as an equal partner. And to have them Bringing opportunities and resources to you. This podcast will help you do just that. Welcome to the Nonprofit Power Podcast. Hey there folks. Welcome to another episode of the Nonprofit Power podcast. I'm your host, Kath patrick. I'm so glad you're here for today's episode. Pilots can be a great strategy for setting the stage for sustainable funding. Many nonprofits have successfully leveraged a pilot project to unlock millions of dollars in funding and to achieve key policy changes that ensure those services are always available going forward.

1:33 But too many pilot projects end with no discernible impact on funding or policy. And that's a shame because it doesn't have to be that way. The truth is if a nonprofit makes one or more key mistakes when setting up the pilot, it'll probably fail to generate meaningful change. But with proper strategic design, you can dramatically increase your chances of turning a pilot project into longterm funding and policy gains. But it only works if we set it up to successfully prove the case for investment. The basic purpose of a pilot project, whether it's large or small, is to demonstrate and prove value to a set of decision makers.

2:15 You've got something you already know works. You're trying to get the decision makers on board. And engage them, and help them to understand the true value so that they're interested in investing in it. Whether those decision makers are at a government agency, if they're elected officials or a prospective contracting partner. The basic concept remains the same. There's two different ways they can then make good on that investment. They can commit long-term funding. And/or they can institute a policy change that makes the thing that you're piloting become an institutionalized part of a set of services that is always funded and is always part of the system.

2:58 Funding comes from all of those sources. The policy change tends to happen, obviously on the government side, whether it's elected or agency officials. But the bottom line in all of these scenarios is that if the decision makers were already convinced that your thing, whatever you're looking to pilot to prove its value. If they were already convinced that your thing was the best ever, and was a brilliant return on investment and produced the kinds of outcomes they cared about. And it made total sense. Then they'd already be funding it and those policy changes would already have happened. So if you're finding yourself wanting to do a pilot to help engage those decision makers, to move them to that.

3:41 By definition that means that they're not there yet. There's one or more things in the way. Very often, it boils down to one basic concept. They're reluctant to make the investment, whether it's funding, policy change or both. Until they're sure that your thing is gonna produce the returns that you say it will. And that it's going to work for them. And this is key because you can have lots of data that shows that it worked other places. Or that it worked in this setting or that setting. But each decision maker is looking at it from their little world.

4:23 And they want to know that if they make the investment they're going to get those same returns or better. And so the great thing about a pilot is it allows them to make a small investment, relatively speaking, to find out if it's really gonna work for them. So it's a great strategy. But here's the thing. There are four major mistakes that frequently get made when setting up pilot projects. That wind up not proving the point to that decision maker, and not getting them to understand that it's really going to work for them. And those four big mistakes are number one, failing to define success.

5:06 Failing to get adequate data that actually proves your concept and satisfies the investor slash decision-makers needs. Failing to get partner engagement and cooperation to do their part. And the last one is failing to cover your costs. So let's get into these because if you get these four things right, the chances of your pilot project succeeding beyond your wildest dreams go way up. So the first thing is to define success. And when you're doing that, what often happens is that success will get defined for the client. This is the outcome that the client will experience, et cetera. We're pretty good at defining success for the clients.

5:48 But you want to define success for three different entities, three different parties. For the client. For the decision maker and their organization or business. And for you and your organization. Okay. So obviously with defining client success, that's going to be all about the final outcomes, but also any key incremental milestones that are important and relevant and should be measured. Because particularly if you provide a service that it takes a while to get to the final big outcome, it's going to be very important to create milestones that show progress. And for any milestone that is a big win on its own, and that changes the client's life for the better, then that should really be labeled an outcome.

6:40 So if there's a completion of a process. If you're in workforce development, it might be that they're incrementally achieving gains in training or education or apprenticeship. Whatever the method of improving their skillset and capacity. It might be around improving capacity in soft skills arena, which are totally critical to success in the workplace, no matter what line of work you're in. It could be a set of strategies and services that fully address childcare needs of clients so that they can successfully participate in and complete their training. In those scenarios in workforce development, there are a lot of incremental milestones on a career pathway.

7:23 And you want to be able to very clearly define outcomes attached to each incremental piece of progress. In healthcare, you might be looking to show incremental progress on someone's journey toward wellness, toward their best health, whatever is going to be possible for them. And that will depend a lot on what they're dealing with. But you want to show each key milestone of progress. And characterize each of those as an outcome. And then ultimately of course, is your big outcome that you're looking to get at the end. You know your services and the incremental milestones that your clients go through on their way to the big outcome that's the big payoff at the end.

8:08 But the truth is that in almost every scenario, no matter what arena you're operating in, those incremental milestones are critically important. And valuable in their own right. And so you want to make sure that when you're defining success, you're calling those milestones out as part of the success picture for the client. That's just part one of your three part success definition. The next thing you do is you identify what constitutes success from the perspective of your organization. So obviously there are going to be some key things, right? You have your final outcome goal here of you want X level of funding investment to happen.

8:49 You want it to happen on a recurring basis. You may want the service or program to become institutionalized in a larger system, so that it becomes standard practice. And that would probably be a policy change of some kind. Or you may want both. So get really clear on exactly what that would look like as your end goal of success for this pilot. Then there is from the perspective of your organization specifically, what is the success for the organization? And that's about what level of not only overall funding do you get out of this. But at what percentage of your cost?

9:29 We're going to get into that more when we talk about making sure you cover your costs. But that is definitely one of the factors that go into this. It is not a win if you pilot a service or a program at a funding level that is money losing for your organization. And your goal is to scale that. What you ultimately would be doing is scaling your loss. That is not a good goal. We want to make sure that you're getting adequately compensated for the provision of the service or program. So that's one of your successes is that at a minimum the costs are covered. And then there are going to be other things. Perhaps it's that you will be able to grow your team or grow your team's capacity.

10:11 There'll be other outcomes for the organization as a functioning entity that will be relevant. Another one may be that your organization emerges as a leader, or as an even stronger leader, in this field. That enhances your reputation for expertise, for skill, for success, for showing up as a quality partner. Whatever reputational enhancements you want out of this, define those as well. One of the big ones is going to be that you will have more data, and better data, when you are done that prove your case, that prove that the return on investment is what you say it is. Or that reveal for the first time what the return on investment is, if you don't already have that data for this thing.

10:57 So your categories are data, costs, capacity building, whether it's of your team skill set or your total team numbers. Or physical plant capacity it's depending on what it is that you do. But it's not a success for your organization if you don't prove your case. And if the organization doesn't come out of this better off at the end of it than when you went in. By any number of measures. And you obviously will decide what those are, but these are the major categories that you want to be looking at. Because if those aren't built in from the beginning., How would you ever expect them to be your results?

11:39 None of these results will happen automatically. They happen because you've designed it into the pilot that you're going to get those results. And you will have built a strategy for each one of your desired results. Then we take a look at what constitutes success for the decision-maker and their organization. And obviously the decision maker is going to have to be involved in that conversation. But one of the little secrets of successful pilot projects is that the best way to get really good success measures for the decision-maker, is for you to engage them thoroughly. And really lead that conversation. At a minimum, of course you would ask them to tell you what their definition of success for the pilot project would be.

12:25 But that's not going to really get you what you need. You're really going to have to lead them through the conversation. And it's very important. Do not have this conversation with the decision maker until you have already decided what all the success milestones and outcomes for the client will look like. And you've identified what success looks like for you. Then you go to the decision maker. And you say, okay, let's talk about what your definition of success would be. And success meaning, this would be a set of results that would make you say yes, this service, program, whatever it is, needs to be institutionalized.

13:10 Needs to be made standard practice. Needs to be funded longterm. Whatever your goal is around this. What would you need to see in the way of results for you to say, yes, that means that we should do that. And then don't be surprised if when you ask that question, they don't really have an answer. So what you then do is take them through a series of questions to elicit from them in detail, what would be the thresholds for them? When you've already identified what for you constitutes all the different successes for our client and all the different successes for you and your organization. Then you are well positioned to take the decision maker through basically those things, and say, you know, this is what we see as indicators of success.

14:01 Do those resonate for you? What would you add? What would you change? But give them something to react to. It's better to do that than to just say, so what would constitute success for you? Because you don't know what they'll say. And they probably will not have thought it through all that well. So your best bet is to lead them through the conversation in that way. And if they still can't answer that after you've taken them through that set of questions, then you already have a problem. Because if they don't know what ABC and D things are going to have to result from this in order for them to say yes, this will be worth a long-term investment.

14:42 Or a long-term policy change or both. Then those longterm uh, funding and changes will never happen. Because there is no threshold at which it becomes a yes for the decision maker. So that has to be defined upfront. And it doesn't have to be super precise necessarily in terms of numbers. You need to get them to get clear, if not completely precise. So. For example in workforce development. Usually they're pretty focused on wage outcomes. And for good reason. That's important. But there are a lot of different ways to talk about that.

15:24 It could be a percentage increase in earnings power. It could be the securing of a specific credential that leads to specific earning power. It could be any number of things. But it wouldn't necessarily be something like everybody will make X dollars an hour when this is done or the project hasn't succeeded. That's too blunt a measurement instrument. That's why you want to get to all the incremental pieces of what success looks like. So you've done all that. You've defined success for all three major entities involved in this process. Right on the heels of that. Data. Data and more data.

16:05 There are two pieces to this. One is figuring out what data you want to have when you're done. And the second piece is figuring out how you're going to get that data. Because it's not automatic. So the first part, what data you want when you're done. Is fairly simple, if not easy. It's tied directly to all the things you said were measures of success. Particularly for the clients. And for the decision maker. And any of the pieces that are data-relevant that you've included in your own success definition. You know the incremental milestones and outcomes that you want for the clients that will constitute success.

16:45 You know what the final outcomes are that will constitute major success. You've engaged the decision maker to react to that and your other definitions. And they have now shared their either tweaks to what you had already laid out, or their special take on it. Or added layers of nuance to it. They've given you that nuance in the success conversation. And then. This by the way could be the same conversation. I'm breaking these out to illuminate what it is you need to make sure you get and do in this process in order to have a really resoundingly successful pilot. But you might very well have the success conversation and the data conversation with the decision makers all in one go.

17:33 You just do the success part first. And then you say, okay, so how will we measure this? Basically. And then you'll get into. Okay, so what kind of data would we need to have? What would it need to show? What would it need to prove? And you get that all listed out. And the easiest way to do it is under each success element. You can say what data are attached to that. And then are there any overarching data that would be important that we want to make sure we have when we're done? And obviously what are the data we're going to need in order to be able to calculate return on investment. So. That's great. You get that clear.

18:13 And then the conversation you must have with the decision maker is. So how shall we work together to make sure that we get this data when we're done? This is critical. This is the most common mistake that I see over and over again with pilot projects. Is even when the success is fairly well-defined, and the desired data is fairly well-defined. The mistake that commonly gets made is that either everybody involved assumes that the Nonprofit will take care of getting all that data. Or the decision-maker assumes that, while the Nonprofit is busy assuming that the decision maker's going to help with this data gathering, and analysis by the way.

18:57 Raw data is one thing, but then it's got to be analyzed. And so you want to be able to work closely with your partners to make sure that that data answers the questions you both need it to answer in a way that is helpful and compelling for both of you. And the only way that's really going to work is if you do that work together. Also, it's very common for whoever the partner is to have more resources at their disposal than you do in terms of data collection and analysis. So you want the workload to be proportionate. And you also want to leverage any special skills or expertise or capacity that they may have on any of those fronts.

19:38 So make zero assumptions. Be crystal clear. And get it in writing, ultimately. When you're first discussing it, you're just identifying what you both want in this process. What data you're going to need. For them, it's what data is going to show the ROI that we need and the impactful outcomes that we need. At a threshold that will make us say yes, this is worth the longterm investment and/or policy changes to institutionalize this service or program. So you define it first, and then you have the conversation about how do we make this data actually happen?

20:19 What's that going to look like? Who is going to be responsible for which pieces of data collection? How will we share data with one another on an ongoing basis? And how will we work together to analyze that data? So that when we are done, we have clarity about whether or not we have met our success thresholds, and whether or not we have met the threshold for, yes, this is a worthwhile investment long-term. And you don't quit until you've gotten the decision makers and/or their team to make well-defined commitments to do their part. Because some of this will be the decision maker says yes, yes. My team will work with you on that.

21:00 Well, okay, great. In theory. But there's often a big gap between what the decision maker said their team would do. And then what memo the team does or doesn't get about what they really have to do here. So ultimately you're going to want those details spelled out in writing. In a letter of agreement, in a memo of understanding, in a contract, whatever format you're going to be working with. But there should be a formal agreement between you and the decision-maker entity about exactly what this is going to do, and how you're defining success. And what you're measuring and how those measures are going to be achieved, shared and analyzed.

21:42 And those roles should be spelled out in detail. Now you work that all out first. You're smart. You know, that you don't just come in with your list of demands, but you also don't come in assuming that you're going to have to carry the entire workload because you can't. There are things that only the decision maker and their organization can do. Particularly in the healthcare space. Where there are HIPAA issues and all sorts of data controls that are very thorny to deal with and require a lot of planning and negotiation and cooperation to make sure that that actually happens.. Ultimately, you're going to get that all in writing.

22:22 Which leads us to the third piece, which is partner engagement and cooperation. So obviously, data is a huge piece of that. The other reality here is that of course you have a primary partner in this pilot, which is the decision maker and their organization. Whether it's an agency or a business, or a set of elected officials, whoever it is. They're committing their organization and their teams, their resources to working with you to make this thing happen. Based on whatever you've agreed to together. But there may be additional partners involved. There may be referral partners.

23:04 If you don't have a direct line to the clients who are going to be coming into this pilot to be served. Then how are they going to get there? Is somebody going to have to refer them in? What is the responsibility of the referral partners and what do they have to do in this process? Will they have data collection and reporting obligations? If they're doing a piece of the process that's going to generate data, you need a way to be able to collect that. That's going to require your engaging those partners as well. And sitting down with them and having those same conversations with them about what will success look like for you? They have to be invested in the success of this pilot, or they will not play at the level you need them to, in order to yield the results that you want.

23:54 So every single partner who may be involved, whoever they are. Maybe it's other nonprofits, maybe it's another arm of an agency. Maybe it's independent entities, whoever it is. Anybody who's going to be involved in the system here who are going to have a role. You need to engage them and take them through the same process of defining success. Identifying data that's going to be collected. Getting their agreement to actually do that, getting their commitment to get their teams to do that. Cause again, what the decision maker commits to and what the team actually executes on can be very different things. And then you need clear, agreed upon lines of communication for how you're going to communicate through out the pilot.

24:40 So that the first moment that anything pops up that was unforeseen, or that becomes an issue or a problem from either direction. You know, maybe your referral partner is having a problem they didn't expect to have. They need a way to let you know about that. Similarly, if you're experiencing that one of the referral partners is not seeming to produce any referrals. Something's wrong there. You need have agreed upon ahead of time, who it is you call when that happens. Who is going to promise to answer the email or pick up the phone when you reach out, and work with you to untangle whatever it is and get it working right. But all of that needs to be laid out and agreed on.

25:23 And you can't assume anything. I know this sounds like a lot of work and it is. But if you don't do this work upfront, then when you need to call somebody, when you need to engage a partner and you say, Hey, this isn't working the way we said. As soon as you're trying to raise a problem, suddenly nobody's in charge. So you want to know ahead of time, who is it that you call. And they need to know who to call in your shop. And you have to have that super clearly lined out in your own organization, too. That communication obligation definitely goes both ways. It should go without saying, but so much of the success of any project, and pilot projects are included in this, is the relationship building work that you do.

26:07 Better, stronger, deeper relationships you build with all of the key players, with all of the partners in this process, the better things are going to go. And, communication is always vital, but communication goes so much better and more smoothly when you have a good solid relationship there to begin with. When you have a relationship, people are quicker to respond to you. And they're likely to respond to you in a more favorable way. They're more likely to want to extend themselves a little bit to do the thing that you're asking them to do. It's critical in every aspect of advocacy work and pilot projects are by extension, another form of advocacy work.

26:49 They are certainly about strategic relationship building. So always build that into your project planning and your work process for the lead up to the pilot and the duration of the pilot. And the last thing is you gotta cover your costs. This can be tricky for a couple of reasons. One, if you don't know going in what your full cost to deliver the service is, you need to do that before you do anything else. And here's why. The whole point of a pilot project is to ultimately set up a scenario in which the resources available to support those services are expanded substantially.

27:35 And so, presumably that means that your organization is going to be at least one of the organizations providing those expanded services. So, functionally, it's a growth model for you, right? Part of the reason you put all the work into building a successful pilot setup is that you expect to get a big return for your organization and your clients long term. And for the organization, that return is greater reach, greater impact, ability to serve more people, and more money coming in the door. But if you set up in the pilot, a situation where you are providing services for less s than your actual cost, you are setting a very dangerous precedent.

28:20 First of all, you are training the decision maker partner here to expect to be able to get your stuff at a discount. Now, they may not even realize they're getting it at a discount. Maybe you don't realize they're getting it at a discount. So first and foremost, you must know your actual true cost, your full cost of providing a service. That means everything. That's all of the goods and materials that may be involved, it's all of the staff time that may be involved, it's the admin, it's the rent, it's the so called overhead and indirect, and all of those things. Those are part of your costs. And if you don't currently have a model for breaking out all those costs into a full cost of service, that is something you're going to want to do sooner than later, because if you're planning to grow this line of business, this line of service, you don't want to grow something that is money losing.

29:20 if you set it up that way, then the danger is you're going to continue losing money just at a faster pace on a bigger scale. So there's a lot to be said, and it's really a whole other episode about how to do full cost calculations. And there are some good resources out there for that. But the short version is it's very important. It's particularly important with a pilot where your long term goal is to grow this thing and expand it. The other danger here is if you're getting paid below cost, you're compromising the ROI calculation. The decision-maker is participating in this pilot because they're looking to see, is this going to be a good investment, long-term, at scale.

30:03 If you're not giving them the full cost from the beginning, then they can't really make an informed decision about the ROI. Because in the pilot, they're investing at a lower rate than it actually will cost them long term. So you want to, from the very beginning, be very clear about what the full cost of providing the service is. It's possible, even probable, that a decision maker might balk at that cost. Maybe they will, maybe they won't, but you should be ready for the possibility. But what you don't want to do is negotiate with yourself ahead of time out of fear that they won't like the price. If you say to yourself, oh gosh, we just calculated our full cost and that's too high, as defined by what?

30:46 I don't know. But you tell yourself that's too high, so ooh, we can't give them that price. We better give them something lower than that. Where is that other money coming from? You don't want to create an expansion model in which you are operating functionally at a loss and are in the position of then having to raise additional dollars, for the purpose of subsidizing a service that should be paid for at its full value. So, part of what you're engaging those decision makers about from the very beginning is helping them understand the full cost and why the cost is what it is. And why it's still going to be a great investment. Almost always, any high quality service that really makes a big impact and change in clients lives, produces an outsized return on investment.

31:33 It more than pays for itself. So the question is basically, how do you articulate that? How do you message around that so that the decision maker understands that? And if you want some help in dialing in that messaging, check out episode nine. Where we shared how to get decision makers to pay top dollar for your services. And that goes into a lot of messaging around this very question. So those are the four ingredients. The four most important things to make sure you do before you start your pilot project is define success for your clients, for you and for the decision makers organization.

32:14 Get super clear about exactly what data you're going to need in order to demonstrate that that success actually happened. And to build the case for expanding the service or program beyond that. Make sure that you have a clear and agreed upon plan with your decision maker partners and other partners. about how that data are going to be collected, shared, and analyzed. Make sure that you have a plan for engaging the full cooperation of all of the partners for all of the things that they are responsible for or have a shared responsibility for in terms of getting to the ultimate success points.

32:55 And lastly, Be 100 percent clear about what your true full cost is to provide these services. And make sure that you negotiate with the decision makers. to ensure that your organization will be compensated at full cost for the provision of the services during the pilot. And that there is an understanding that that will be the cost going forward. Build relationships all over the place. And the stronger and deeper the better. Communication is critical and communication goes vastly better when you have strong relationships in place. When you've got all that together, the other thing is get it in writing.

33:37 Make sure there is a contract or a MOU or letter of agreement or whatever you're going to have with each of the partners who share some responsibility in the success of this project. Make sure that there are written agreements about who's responsible for what, what the lines of communication will be, and particularly what the process for solving problems jointly will look like. And then with that in place you are ready to proceed with your pilot project. And if you have all that in place and you stay on top of it, because the communication, the data collection, the data sharing, the checking in when there are little hiccups or problems, questions, things people need.

34:21 Making sure that all of that runs smoothly will be largely on you. So you need to have an internal plan for how you're going to staff that. Who's going to be responsible? It will probably be more than one person. You'll probably have a point person and then you'll have other people who are responsible for different pieces, but you want to have that clearly laid out in your own organization so that your team understands what each of their roles are in the context of helping this pilot project to succeed. When you do that, you are in position to have a wildly successful pilot project that does what you wanted it to do. Which is end the project with clear proof to all the parties involved, but especially the decision makers, that the return on investment for this is so rock solid, that expansion of it, making it standard practice, adopting it into policy.

35:16 Any or all of the above, whatever your goals were from the beginning. That doing that is an absolute no brainer. And the sooner we do it, the better, because everybody's going to be better off. The clients are going to be better off, and the decision makers organization is going to be better off. And by extension, so will your organization, because you'll be expanding your impact, and you'll be increasing your sustainable funding. And that, no pun intended, is the bottom line. Thanks for listening and I'll see you in the next episode right here on the Nonprofit Power Podcast.