Should I commission more strategy work from agencies? This item cross-posted to Goodlookslikethis Dug's work blog

Last year I commissioned agency strategy work to the tune of a little under a million pounds. With the advantage of hindsight, I have to ask myself, "are agencies who produce experience strategy really worth the money?"
The first of the two strategy pieces was run by a really smart guy at a great agency but ultimately, the work they produced had little or no impact on our business. It didn't inform our decision-making nor did it transform any of our research and insights into actionable recommendations. Basically, and no offence to the bright folk who wrote the strategy documents, their work ended up as a couple of big fat Powerpoints on the S: drive. Those docs were briefly consulted then largely forgotten.
The second strategy piece cost twice as much as the first but achieved little more. The brief was to help us accelerate our performance improvements and we went to a leading consultancy in the hopes they would have significant positive impact on our company (or at least our trading performance).
Where the first project likely suffered from poor access to stakeholders, this second one involved a large team of folk in dark suits who made it their business to go as deep as they could and get the information they needed from the right stakeholders.
At first the results seemed encouraging, the team produced a number of documents with amazing facts and figures. Using what I must assume is voodoo and pixie dust, they were able to attach precise performance metrics to general user experience improvements (both UI and UX) and those percentages of 'uplift' (a new word I learned last year) were extremely useful in writing budgets and of course going to the board for cash.
To be fair, the key objective of this second consultancy piece was to generate supporting evidence such that the executive committee could approve a very large budget. Serious people and serious money, so I perfectly understand the need for large documents filled with precise facts and supporting appendices ("the details are all in the appendix" is another favourite bit of consultant-speak I learned last year).
Unfortunately, this strategy also had a fatal flaw. Because it was created top down, with no deeper or longer-term stakeholder engagement, it only took a small change of weather at the top for the budgets to be cut and the whole programme to be shelved.
Now if you ask me, that's a lot of cash (and a lot of time) spent for not a lot of positive outcome. I'm actually looking at my own strategic thinking so I'm not (just) having a bitch and a moan. I am genuinely curious to get a feel for the sustainability of the customer experience strategy industry and learn from the mistakes I made last year so next time this happens we'll get a better result.
Items 1, 2 and 4 in the diagram above make up what you might call the "strategy context" of the brief. I reckon this is where the first agency came a cropper. Specifically, we didn't tell them absolutely everything about the business and they had to make assumptions as to our likely performance. Their analysis was actually pretty clever but we hadn't completely gelled our vision, values and purpose. This meant fragmented results and there was no way our organisational delivery was going to be able to cope with the agency recommendations.
I guess there's a lesson here. If your customer hasn't nailed vision/values nor indeed sufficiently clarified objectives, don't go into strategic analysis. Maybe the brave thing to do is say "we love working with you but let's revisit this in six months when your brand team has had a chance to clarify where you stand" (or words to that effect).
If strategic context was the downfall of the first project, team process was the problem with the second. The consultants were able to get a reasonably good fix on the strategic context (the brand had gelled more since the first team) but they worked to a time-frame that didn't permit the embedding of the "organisational delivery" of their proposed strategy. Simply put, they didn't get deep buy-in across layers of management.
I'm not sure what the answer is here but I'm guessing when one budgets one's headcount on a strategy project, perhaps it would be worth spending a little extra on getting people on the ground to build deeper commitment to one's strategy (could this compliment the usual idea of providing a deck as 'armament' for a director to then socialise in the business?)
Finally, I wonder how much work went into tailoring the work to a client-side audience. I found large parts of both agencies presentations and documentation to be very opaque. You can be as clever as you like but if you don't stimulate your stakeholders to action you're not really having any impact. Something to think about...
There are a hundred other lessons to learn here as well but I'm concerned with those that directly impact the client/agency relationship when dealing with strategy development.
Are you Director of Customer Experience Strategy in an agency? Comments on a post-card please:-)
Hammad
Hi Dug
As the Director of a UX agency (Zabisco) I'd be glad to share my views with you.
Unfortunately, in my days as an independent consultant, I've witnessed first hand how a lot of the 'top' UX consultants tailor their strategy to the client audience; literally to the point where they'll have a 'strategy meeting' to discuss how to do this! There can also be a tendency to encourage client stakeholders into 'active' workshops, so they feel like they have done something at the end of a (very expense) day; bearing in mind the client paid for said workshop too!. This is often not much more than post-it notes on a wall to extract what each stakeholder will likely sign off budgets for! Needless to say I walked away from such agencies and projects as I couldn't put my own integrity to something that wasn't genuinely built around improving customer experiences.
As you've said, the effectiveness of an external strategy can fail from both sides of the commission; a client not opening themselves up enough, or having the right people backing it etc. However, I do feel that an external agency has a duty to work a bit harder at seeing their strategy through.
Here are my main thoughts on the client/agency relationship specifically (as this is what you were keener to hear right?)
1. Practice what they preach. If a customer experience consultancy hasn't properly understood YOU as a client early on, then they clearly aren't taking their own advice and more worryingly - it isn't part of the culture of the team/office. I'd expect the lead consultant(s) to know exactly how to present their information to you in a way that stimulates the stakeholders - death by PowerPoint isn't really excusable in this scenario I'm afraid - the communication of the ideas and strategy should be short, clear, visual and in sync with the personalities at the client. If they get this right, it's a good sign. We've been using more infographics to explain strategy and providing them as leave-behinds (prints, desktop wallpapers etc) and it works very well.
2. Passion test. Are the people leading the strategy work at the agency genuinely passionate about trying to solve your brief? This should be obvious in their body language and the pace/flurry of their actions. They need to understand and respect the fact that they are external to the client and therefore have a duty to to immerse themselves properly; otherwise the strategy will be as disconnected as they are. Obviously, the blog of a UX agency is a good way to check out their culture in advance too.
2. Follow up. Once the strategy is delivered, the consultancy should be chasing it up, so see if its going to be implemented untouched or if the stakeholders having butchered it - in which case, they should have a plan B, C, D - so that the core of the strategy is still intact and still has impact. If they don't do this, it's the final sign that you've been stiffed. Agencies often complain about their masterpiece being ruined by a client, but how many of them actually care enough to soften the impact of this. They are agencies after all - they should be dealing with reality and not fantasy.
I'd recommend to any client that before commissioning an agency for strategy work, get them to spend some time with you to get a feel for the points above; once you're happy, give them a more punchy brief. If the click isn't there early on, walking away is a less expensive waste than a big Powerpoint deck or a disgruntled team of stakeholders. That goes for both parties too - as any consultancy worth their weight will be concerned from day one whether their work will deliver results - otherwise they are just selling voodoo and pixie dust.
If you do decide to work with agencies on strategy (or delivery) again, I hope it's more successful than the tales you've told here.
(I'll resist the shameless plug for ourselves!)
Cheers
Hammad Khan
Director @zabisco