Tag Archives: dr prof phil klaus

Why we need to rethink how we measure Customer Experience

There’s a rage of words between Ryanair and anyone measuring their Customer Satisfaction which presents a different score to what they believe it is.

Which! have a 52% rating for Ryanair. PA Consulting have them pegged even lower. Whereas Rate My Trip has a 92% customer satisfaction rating. Ryanair understandably support Rate My Trips’ poll.


But forget the squabbling, the real enemy here is the lack of understanding of how customer satisfaction is calculated and inconsistency in collating and measuring customer satisfaction across sectors.

We all love Which! I was a subscriber for years, often checking the best product options (sadly often after I made the purchase). Which! has more proportion of their measure accounted for by price related criteria than other studies such as award winning behavioural based EXQ which has found it to be much lower in studies.

Often a suite of criteria are presented with equal importance (again EXQ has identified that is never the case). These measures are then wrapped up and badged as overall Customer Satisfaction. So it seems what Customer Satisfaction is often whatever the organisation using it wants it to be.

This isn’t unique to Ryanair. I’ve met numerous insight managers who do not agree with the criteria used by others to measure their performance.

If you asked a customer what the criteria should be and how much weighting to apply to their situation, I am sure you would receive back as many combinations as customers asked.

But many consumers place high value on these satisfaction measures in their choice criteria, assuming they are all the same. But the are usually unaware of the wide and varied ways companies collate and grade customer satisfaction.

‘Satisfaction’ as a measure of performance also provides an unreliable indicator for companies to track, according to studies completed by Prof. Dr Phil Klaus, world leading academic on customer experience. No one said it was an indication of profit, but many companies do share CSAT at board level assuming if it goes up, so the company will be more profitable.

Ryanair could be the most profitable short haul carrier around but have the lowest satisfaction rating. If they operate a budget airline then something has got to give. In their case it’s the experience of the customer. Is it sustainable? Perhaps yes. This year’s poor Customer Service has delivered a 20% increase in share price YoY for Ryanair. No one states you have to be nice to your customers.

So Customer Experience practitioners should be cautious about  presenting Customer Satisfaction increases as a sign of business profitability improvement. In the Wealth Management and Private Banking sector studies show those topping the customer satisfaction polls are way off the pace when it comes to corporate profitability rankings.

Affected behavioural change is a very reliable measurement approach because it’s an ‘actual’. Whereas satisfaction is a measure of a customer’s sentiment at a moment in time. Similarly, NPS measures an intention to be actioned. They do not reflect what customer’s are or will actually do. Measuring the impact of a behaviour change is an actual.

We can measure CX impact on behavioural change, so why do companies prioritise satisfaction?

It’s an easy one to put to customers. They get it. However, if you discuss the concept of ‘context’  capturing customer satisfaction, most admit they struggle to associate satisfaction with anything more than the here and now they are asked about.

So if a purchase went well the customer might feedback a high score. However, if part of that transaction was the reassuring returns policy which then turns out to be useless, they cant go back and correct transaction moment score even though it was influenced by the perception of the returns policy.

VoC platform providers like satisfaction as well. It’s a one question solution. It’s easy. It’s relatively unchallenged. It can be asked across channels and compared between journeys, segments and other variables. It’s a commercially viable currency for them.

Is there a more accountable measure available?

There is a much more reliable customer experience measure. One which presents 90% accountability of what CX drives customer’s decisions. One which has been proven to be 90 times more reliable than CSAT and NPS in identifying what drives customer’s decisions. One which would enable both Which! to reflect more accurately the complex set of criteria customers use to inform decisions and is based on ‘actual’ contribution to the company rather than a sentiment score such as satisfaction.

This measure is known as Experience Quality Measure (EXQ). It’s not widely known about because it’s an academics measure for customer experience. We found it a few years ago and now find it fascinating. Academics are interested in discovering the truth rather than headline scores so it’s a more ‘spikey’ data set to work with, but so much more informative. !0 years or so a group of academics agreed CSAT and NPS weren’t reflective of the truth, with a less than 1% reliability of customer’s actual decision making being attributed back to scores provided on these measures, so the pursuit of a more accountable measure led to the creation of the award winning EXQ.

It was identified there are 300 drivers which influence 100% of our decision making. It’s complex. But further studies discovered over 90% of decisions can be identified through just 25 of these drivers. At this level it becomes a study to be put to customers, as we have now done several times. 

What does EXQ deliver?

  • Identifies which customer experiences matter most to customers decision making
  • Highlights the importance of each of these drivers (typically 8-9 drivers account for 66% of decision making)
  • Identify the customer experiences companies deliver which have almost no impact on customer’s decision making – creating immediate opportunities for saving
  • Because we collate ‘share of category’ decision making we can highlight how your score benchmarks to your competitors and what drivers that is based on. This provides an indication of true differentiation, as perceived by your customers. As well as expected experiences for the sector
  • Provide cross-border comparisons to enable groups to make truly global customer  comparisons
  • We use an award winning academic research designed to get the truth of customer experience
  • It’s a one off study which is not reliant on tech platforms so can be delivered in 6 weeks
  • It’s a study and not a tech solution, so the cost is comparable to a few focus groups

In EXQ studies we have run with clients, we highlight the 25 most important customer experience behavioural drivers. What is often surprising to clients is that what really matters most to customers is very different to the areas the company has invested it’s marketing budget on. The decision is then whether to accept the new insight and rethink the strategic choices they make or to bury it and pretend it never happened and hope it doesn’t come back to haunt them. We’ve run studies where both outcomes have played out!

EXQ is not for the faint hearted, but it is for those driving for successful in CX. Studies have been run with over 1,100 companies around the globe which highlight the best performing EXQ companies achieve a 600% ROI from CX. Although only 3% achieve this.

For more on EXQ click the link below. Or contact Christopher Brooks at Lexden to find out how with just 6 weeks (and a fraction of the cost of CSAT) you can have a CX which will refocus your CX efforts around ‘what matters most’ to your customers and what drives your bottom line.

If you are considering this option, it might be worth undertaking a ‘comparison’ study using EXQ to identify what really drives profitability. EXQ can also informs what customer behavioural drivers deliver CSAT and NPS scores – which can be most revealing. This time in two months you can have the answer for the equivalent of a months VoC running costs.

But it EXQ isn’t for you, when it comes to measuring CX be sure that 1) it reflects what’s important to your customers decision making and 2) you are certain of the impact on profit of chasing CX targets.

Posted by Christopher Brooks, Customer Consultant, Lexden (London)

If you’d like to receive more articles on driving more profitable Customer Experience, please sign up to our free monthly ‘Customer Experience Update’.

Lexden helps deliver effective customer experience insight, strategy, content and creative activation clients seeking sustainable profit from customer experience.



Free Customer Experience Progress Assessment

As independent Customer Experience Consultants, we have launched a free Customer Experience Programme Assessment tool to help clients review their internal practices against several areas where alignment is required to achieve distinction through customer experience.

We see the benefit to you as follows:

  • Identify the key areas involved in progressing CX
  • Identify where you are ahead or behind others in terms of your CX progress
  • Assess what progress looks like, to ensure you are good shape to get there
  • Help you assess where you are ahead of any resource decisions coming up
  • Get a quick read (within 3 days) with minimum impact on the business
  • Provide current state insight which you can share with others helping you take CX forward
  • Validate or challenge advice and recommendations received from current CX partners
  • Receive an independent observation separate to any vendor supported opinions

As independents we have no invested interest in the outcome

We include consideration of feedback platforms and other technologies alongside the other key areas of CX rather than the focus as is often the case with vendor assessments. We are in the business of best practice guidance and effective advice rather than tech solutions. So our report provides you with a broader appreciation of how far you’ve progressed.

Each of the key practice areas (such as channel management, accountability, tech, adoption, measurement and culture) are graded from ‘Unaware’ to ‘Differentiating. The grading is based on Lexden’s extensive experience in setting up and improving clients CX programmes. Your progress is plotted accordingly with an output report highlighting your overall progress and breaking this down across key areas. A comparison of your performance to other companies is also made across each area.

More than one assessment per company can be completed. This means you can use the approach to gauge the variance in perceptions of CX progress across the business between different individuals, levels, roles, departments, locations or even brands in a group set up. Let us know if this is the intended purpose and we will aggregate results as well as supply specific reports.

Click this link to the survey which will take 10-15 minutes to complete. Information collected is confidential. Once the assessment is complete we will confirm this and forward the output within 3 days.

How to achieve 600% from your Customer Experience Programme

If you are looking for something more comprehensive we also provide a robust assessment of the profitability level your CX programme is achieving, bench-marked against over 1,000 organisations. Adapting the award winning CX Typology(c) Measuring Customer Experience research of Dr Professor Phil Klaus, we assess your current programme against 47 practice points. Arriving at a score, CXPPA (Customer Experience Programme Profitability Assessments) pin points where improvements in your programme should be focused, and how to align your actions to those of organisation who are driving 600% more from their CX programmes. To receive more information on this exclusive assessment please contact us.

If you’d like to receive more articles on driving more profitable Customer Experience, please sign up to our free monthly ‘Customer Experience Update’.

Lexden helps deliver effective customer experience insight, strategy, content and creative activation clients seeking sustainable profit from customer experience.

If you’ve got a CX challenge, see if we can help.

Are you wasting money on Customer Experience?

With 90% of CEO’s prioritising Customer Experience as a leading business practice(1), financial scrutiny on performance will only increase to retain board confidence and commitment. However, 90% of programmes are failing to deliver (2) their potential.

How can you be sure Customer Experience investment is correctly prioritised?

Most manuals and professional CX speakers would advise practioners to fix what’s upsetting customers and move on to making a point of distinction on what they rave about. Which should push up satisfaction and recommendation scores.

However, both these customer experience strategies require investment to succeed. What if there is no budget? Can you ‘hedge’ the required investment against incremental sales/profit this focus will deliver? It’s probably not that safe to do so. Evidence shows that only 1% of share of category can be reliably attributed back to these conventional measures (email me if you want more on why this is).

A more linear approach is to show the reduction in ‘bad demand’ operational costs associated with managing activities creating negative feedback on specific touchpoints. This would show an accountable reduction in costs. Albeit costs created by a bad customer experience in the first place. So should they be classed as a win, or an own goal? Either way, it’s a start.

This gives you the two more common strategies for CX growth pursued:

  1. Improve that which the business is poor at but customer’s value (also known as the ‘Fix’ phase)
  2. Leverage that which the business is good at and customer’s value (also known as ‘Build’ phase)

The shortfall here is that the hit list for these strategies rely on customer’s feeding back about what’s great and what’s not. But what if customers don’t vex about an issue? And why wouldn’t they –  because it’s not on their radar? What if there’s nothing wrong or right about an experience but because it’s not important to customers it never gets raised? With most VoC set ups if you don’t hear about it often it gets considered not worth looking at.

A conventional approach focuses on capturing feedback on customer’s sentiment and intention. But as proved on most voting days, intention and behaviour are often distant relatives. Whereas, understanding actual behaviour caused by Customer Experience is evidence of what customer’s do.

So rather than only asking how satisfied a customer is with an activity or experience, or which activities they are satisfied with or otherwise, understanding how important an activity is to a customer’s share of category commitment brings behavioural based measurement in to CX. Actual behaviour is a significantly more reliable indicator of decision making than intention.

This moves the focus from knowing some of what’s going on, to knowing everything

With fix and build programmes linked to CSAT and NPS inferred scores, there is a read on, ‘what we are good at and what we are not so good at’. By complimenting this with behavioural change insights we are now answering, ‘what customer experiences matters most to a customer’s decision to commit share of category’. This adds the missing commercial dimension to CX performance management and with it reveals two further CX strategies for practioners to pursue. As well as sharpen the purpose of the ‘Improve’ and ‘Leverage’ strategies too:

  1. Monitor and refine/remove CX which the business is poor at and does not impact customer’s decision to commit to us
  2. Improve CX which the business is poor at but impacts customer’s decision to commit to us
  3. Leverage CX which the business is good at impacts customer’s decision to commit to us
  4. Explore the potential in CX Opportunities which the business is good at but does not impact customer’s decision to commit to us

These are shown in Lexden’s MILO matrix below, which enables prioritisation of CX investment.

Lexden’s CX MILO Matrix

The ‘Monitor’ strategy identifies investment which is under-performing and not needed (or as the headline state where a company is ‘wasting money on CX’).

With conventional feedback this insight isn’t unearthed because it’s the customer experience that doesn’t matter to customers, so it rarely gets asked for or feedback provided – whether it’s good or bad. But if this collated less meaningful activity can be refined, reduced or removed and rationalised costs redeployed to the ‘Improve’ and ‘Leverage’ strategies.

Which leaves the ‘Opportunity’ strategy, which provides untapped potential for new areas to consider. These could provide future advantage in a maturing CX-led organisation if reshaped and made important to the customer’s decision making or outcomes fulfilment.

You may be questioning this only works if you know what activities matter in the first place, and their relative degree of importance. If you were starting from scratch that would take longer and cost more to work out than would be of use.

Fortunately, the missing golden insight is already available

Leading CX academic Dr Professor Phil Klaus developed a quality of experience measure which identifies which customer experiences impact customer’s behavioural decisions. In conjunction with Prof Klaus, we work with this leading edge CX insight measure, which means we can now add ‘behavioural change’ insight to existing NPS and CSAT measures to create the missing commercial rigour CX deserves.

With ten years and over 1,000 case studies complete, this award-winning insight informs companies on ‘what matters most’ and ‘what doesn’t matter at all’ when it comes to customer experiences impacting share of category decision making. By identifying the most important 25 customer attributes and experiences (refined from a total of 300), the ‘Experience Quality Measure’ accounts for up to 88% of a customer’s decision making. Making it the most reliable CX measurement available.

Each individual study completed highlights the specific set of activities and their relative importance for that company. No two outcomes are the same making it the unique CX DNA of a company. The principal advantages of this approach are as follows:

  • It doesn’t matter which CX measure you have in place already, or which VoC platform you use, we run a one-off separate study alongside what’s already in place.
  • The volume of customer contacts engaged to arrive at the experience measure is around 125, so it’s a much smaller study all round, than a VoC programme commitment
  • We are now into our third year working with the approach and translating the academic science into a more workable and accessible insight source for clients to prove profitability from CX
  • The measurement won’t shift overnight, because it’s based on actual behaviour change, not just opinion. So, we recommend capturing and tracking progress annually
  • Competitor data is also captured which means we also know 1) who else has your customer’s share of category and 2) what customer experiences attract your customers to them
  • This insight can be identified and the MILO matrix complete within 8 weeks

So, there you have it. The ability to identify what drives share of category rather than just favourable commentary.  The confidence to pull out from your plan those activities which matters least. The insight to keep ahead of your competition in CX. Which means CX leaders can demonstrate to budget holders that CX investment isn’t being wasted. In fact, with all four of the MILO strategies pursed it’s driving profitable growth.

If you’d be interested to see how it works with a case study or how easy it is to add this essential CX insight to the CX governance, please contact christopherbrooks@lexdengroup.com 

If you’d like to receive more of these, and other articles on driving more profitable Customer Experience, please sign up to our newsletter.

Lexden helps deliver effective customer experience insight, strategy and solutions for clients seeking sustainable profit from customer experience. If you’ve got a CX challenge, see if we can help.

(1) Bain (2) Dr Professor Phil Klaus

Win a copy of ‘Measuring Customer Experience’, courtesy of Lexden

You will be entered into our prize draw to win one of three copies of ‘Measuring Customer Experience’ when you click here and join our list of subscribers to Lexden’s ‘Customer’s World Update’.  Prize draw rules below.

Recipients of our free bite-size insights, ideas and inspiration for customer-led thinking include Direct Line, Nationwide, Standard Life, JPMorgan, Wells Fargo, Visa Europe, HSBC and many more.