The project you signed off last year has seemingly been going to plan. Then just weeks before launch date small cracks become gaping fissures and you find yourself confronting reality: the project isn’t going to deliver as planned.
When large sums of money and your personal reputation is on the line, there is not a more terrifying or isolating experience. But you are not alone.
Of all large ($10m+) projects started, just 10% are delivered on time, on budget and with required features. 38% are simply cancelled before completion or never used. How does a CIO ensure projects stick to budget and deliver on time - or get them back on track when they slip?
Berkeley has worked with many blue-chip companies including Royal Mail, Marks and Spencer and HMRC to get projects implemented straight through to their successful launch.
Through our extensive experience, we have identified a key dilemma that a CIO faces and one which can make all the difference: Should I insist on outcome-based contracts for my largest projects when everyone around me seems to want Time and Materials (T&M)?
There are many reasons why others may want to get the project started with a T&M-based vendor arrangement:
In our experience, however, insisting on outcome-based contracts with vendors is a battle worth fighting. We share our insights on how this key vendor choice will keep you from becoming one of the statistical casualties.
But first of all you need to work out exactly what you want your outcome to be...
At the start of a project, the number one concern of the CIO is usually gaining buy-in, acquiring the support of peers and bosses – and securing budget to make it happen. An important consideration at this point should be how to go about setting the project up to beat the ugly statistics.
Gaining business case approval can be an important and exciting milestone… but without correct planning and vendor setup ahead of locking down the budget and timeline, the project is unlikely to be successful in the long run. This is especially important when you consider the nature and scale of what failure looks like when a large IT project goes wrong.
A study by Harvard Business Review broke down the overrun of 1471 IT companies to alarming effect. The average cost overrun was 27%. However one in six of the projects was found to be a ‘black swan’, (term coined by Nassim Nicholas Taleb to describe high-impact events that are rare and unpredictable but in retrospect seem not so improbable) with a cost overrun of 200%, on average, and a schedule overrun of almost 70%.
Inadequate preparation prior to project approval will leave you with a project that’s not set up correctly. It may be that the approach has not been thought through or that the project is not grounded in clear scope, good governance and a strong confident team. Or it may be that the vendors have been set up in a way that their goals and objectives become divergent with the client post contract award.
The first step to good vendor set up is absolute clarity on the desired outcome. “Fuzzy business objectives, out-of-sync stakeholders, and excessive rework” mean that 75% of project participants lacked confidence that their projects will succeed.” Geneca’s survey of 600 people closely involved in software development projects found that even at the start of a project many people expect their projects to fail.
Clearly defining your outcomes from the start is a key way to give your project the best chance of success.
It’s a lot healthier to be thinking about the end and the outcome and not thinking about the next milestone where you get financial approval. That would be a hallmark of over-focus on getting funding and under-focus on getting the outcome. It would be one of the warning signs during the mobilization stage that I would say people should look out for."
Hadley Baldwin, Partner
There are two ways to work with vendors, one is to pay by inputs (T&M) and the other is to pay by outcomes.
Focusing on outcomes is particularly relevant when it comes to preparing for an initial contract award with vendors. If most of the project budget will be spent on vendors, having a clear approach to maximizing vendor performance will be key to your success.
Getting a vendor involved from the outset is a good approach for a number of reasons. They often have:
In an ideal world, you want to make the most of that insight while not trading away your competitive leverage or your control over your projects.
So, for clarity…
Paying your vendor by outcome is likely to drive two important behaviors, which will increase your chances of successful delivery:
The ideal scenario is at the outset of a project you can describe and write down what it is you need the supplier to do in a great deal of detail in a way that’s bound and contains what it is that you’re buying and what you want to buy. This allows you to compete that piece of business across a number of suppliers.
The trick is to do that as part of building your business case, so at the point you’re finalizing your business case you’ve seen three or four vendor proposals come in to build what you want to build, and those inform your business case.”
hadley baldwin, partner
Once your business case is approved, you can buy the best proposal that you’ve received, rather than building your business case first and then trying to deal with the vendor second. This way, vendors can help you shape up what it is you need to buy. They can work up their proposals while you work up your business case. If your business case gets approved then the chosen vendor can mobilize quickly.
Establishing clear relationships with vendors from the start is one way of teasing out and understanding complexities as opposed to being swept along by a false sense of simplicity.
Being aware of the nuances of what you are planning to deliver before trying to make it happen will give you the best chance of actually doing so.
Whilst outcome-based contracts offer many advantages, they do not guarantee that the contract will always work in your favor. There is still a chance that some vendors will try to increase their margin by using cheaper labor or adding so many caveats into the contract that it puts all the risk back on the CIO. This is why long-term vendor relationships come in so handy – the trust is already in place.
Making sure an agreement with a vendor is mutually beneficial is another way to make sure you get the best of their services and ensures sustainability.
It’s important to set up vendor relationships that are fair and equitable. You’ve got to expect your vendors to make a profit the same way you’re going to make a profit. The bigger prize is efficiency and setting your vendor up to be able to work in a way where they do what you want and they get it right the first time. Because the worst-case scenario is there’s lots of waste, and the vendor loses their profit margin, and you lose your ability to hit your budgets.
The win-win scenario is the vendor executes right the first time, they give you what you need the first time, so you hit your budget parameters and they make a sensible profit. That’s the ideal outcome.
A key factor in managing projects is to take the long term view all the way through to getting the benefits. Don’t lose sight of your purpose. Unfortunately, this is often not the case.
A study on 5400 large scale (>$15M) IT Projects carried out by Oxford University found that on average, large IT projects run 45% over budget, 7% over time, and deliver 56% less value than predicted.
Whilst the first two statistics are worrying enough, the third highlights an even more pressing concern. If a project deviates from its intended value it could end up becoming entirely worthless, no matter how much time and money have been funneled into it. The study also found that 17% of large IT projects go so badly that they can threaten the very existence of the company, which indicates just how much can be at stake.
Whilst it is important to meet milestones or checkpoints, this should never be at the expense of the overall aim or vision. Over a long 18 month to three year project, it’s very easy to lose sight of the benefits and focus on getting the platform or the product or the systems live… Successful delivery is about having a long term view and being careful in the trade-offs you make.