A Winning Combination: Unstructured & Structured Data Analytics in Today’s Customer Experience Environment
Over the last few weeks, there have been several announcements from large tech players in the world of VoC (voice of customer) and CX (customer experience). My name is Melanie Disse and I have over 10 years of industry experience—most recently in a VoC role at Mercury New Zealand. I thought I’d spend a moment explaining what these announcements mean for those of us who are VoC, CX and Customer Insights professionals. Before we get started, let’s check out what I’m referring to:
You might be thinking, so what? Should I be excited about this? Let’s look into it.
What the Acquisition and Partnership Means in a Nutshell
In a nutshell, Lexalytics, and Tethr are data analytics platforms focusing on structured and unstructured customer data, as well as solicited and unsolicited feedback. With such acquisition/partnership, companies like Pearl-Plaza strengthen their capabilities in the “text analytics” space, meaning their ability to analyze unstructured data and extract meaning and actionable insights. But also in a broader way to be able to connect unstructured and structured data sources to generate insights from within one platform.
The Humble Beginnings of Surveys
Before I jump into the deep end, let’s start at the beginning. Not that long ago, if we wanted to know what a customer thought, how they felt about interacting with your brand (website, store, call center, etc.), or how loyal they are to you, we had to ask them. We sent a survey and asked them what we wanted to know. In fact, almost every company sent surveys, to an extent that customers got rather fed up with it. We ran into the problem of survey fatigue, which plagues many of us.
But it’s not just survey fatigue that challenges the trusted old survey, it’s also the accuracy of insights we gain from it. We sometimes ask questions the customer may or may not know the answer to—for example, did we resolve your issue today? The customer is likely thinking “hmm, well I hope so, the agent promised me to fix it..” We also ask questions we should know the answer to, like “did you travel with us in the last 30 days?” And finally, we ask questions that seem irrelevant or unimportant to the customer, but we want to know more about it, like “did you remember seeing any advertisements on your flight today?” So, we kinda capture the “voice of the customer”, at least on things that are important to the company, and from those customers that can be bothered to respond.
In addition to that, we tend to look at survey results in isolation, and then look at things like financial results, churn reporting, or customer complaints data, in isolation as well. Depending on the data maturity level in your business, you may combine some of your data, but not all of it. You may analyze some of your data, but not all of it—which we know is limiting, as data is best utilized when combined with various sources, rather than analyzed in isolation.
So that’s why I’m excited about the recent announcements. It’s not that I oppose using surveys—absolutely not. They are a great tool in our toolbox, but they are only one tool, not THE tool.
Extracting Meaning from Unstructured Data
There’s one resource that has long been underutilized for mining data—the contact centre! The contact centre is an absolute treasure trove of customer insights and has long been underutilized from a customer insights perspective. It’s an amazing source of customer feedback. We have agents on the phone, email, live chat, and social media messaging. We have bots, call notes, and so much more. So instead of sending a survey, we can now analyze the data we already have, and potentially supplement what’s missing with a survey.
Conversational analytics is also powerful as we are no longer limited to low numbers of survey responses, or hearing only from those customers that take the time to respond. Analyzing the conversation that just took place between your company and a customer means we have 100% of the conversation to use to generate insights from. It means more volume, but also a deeper understanding of your customers’ experiences, as we “hear” from all customers that interact with us.
With acquisitions and partnerships, companies like Pearl-Plaza strengthened their capabilities in this space, using ML (Machine Learning) and NLP (Natural Language Processing) to extract as much insight as possible from those unstructured data sources to tell us what the conversation was about, how the customer (and agent) felt about the interaction, and even predict what the experience was like (e.g. customer effort). Effort and ease, or CES (Customer Effort Score), is a super valuable metric to use in the interaction environment, as it tells us so much about how an experience went from a customer point of view, and is strongly correlated to customer loyalty. Based on unstructured data (the conversation that just took place between agent and customer) as well as operational data (e.g. call history, wait times, transfers, channel hopping) we can predict the level of effort the customer had to put forth to get their query resolved, all without a survey.Â
Analyzing call or chat data helps us understand the conversation that took place, but also what it was all about. It allows you to narrow down on your customer “intent”, or reason for contacting. While we typically rely on agents to choose a “call reason” from a drop down menu, if you work in this space you probably know the accuracy levels of that data. That’s not just because an agent may opt to take a short cut and choose whatever option is right at the top of the drop down menu, it’s also limited to the options we provide, and one option only. Often calls may cover more than one reason, or the contact reason differs from the actual problem that needs to get addressed. Some telephone platforms now offer “intent recognition” and we can also get that information from our VoC platforms if we ingest that data.
Beyond our contact centre data we can also leverage external sources such as social media or reviews. It’s another source of “free” customer feedback we can leverage to better understand our customers, their needs, and potential improvement areas. And again, we pull it into the same platform to have it in the same place as our other customer feedback data for enriched analytical capabilities.
The Power and Limitations of Technology
While those VoC platform announcements are super exciting, it’s not as simple as plugging them into our company tech environment and we have full access to all the shiny toys. You may end up with an (expensive) Ferrari in the garage, unable to drive it. The more data we can ingest into these VoC platforms, the better the quality of our customer and employee insights. However, which data we can share—from a policy, privacy, or tech point of view—determines to what extent we can leverage the tools. If you’re faced with a stack of legacy systems that don’t integrate easily, or can’t even connect the (data) dots between your systems, things become more challenging.
Another incredibly exciting area is predicting experiences, or rather experience metrics. A word of caution here as well—we all know how unique and unpredictable we are as humans. A lot of testing is required before you have satisfactory accuracy levels for your particular organization (similar to intent work). So again, a great example of how we can leverage survey data to gain insights into customers’ perceptions of experiences. Expectations and perceptions make predicting experiences rather interesting.
Wrapping Up
So to wrap up, from a conversational analytics point of view, we’re heading to a state where we know why the customer got in touch and what the interaction was about, what the experience was like from a customer point of view, how the customer felt (emotion and sentiment), and the impact the agent may have had. It’s pretty powerful to have that all in one place, but what do we do with this information?
Firstly, we can enrich it even further with not “just” unstructured data from internal sources, but external sources like social media as well. We can also add key operational or financial data we have on the customer (e.g. call metrics such as handle time, customer tenure, value segments, churn risk, and others).
Secondly, when we bring it all together we see a picture emerging on two levels, the operational level and the strategic level.
- On an operational level we may gain insights to help us train our agents or uncover root causes that we can tackle. Those are typically limited to a specific area, e.g. a call center team, and smaller in nature.
- On a strategic level we are able to uncover an end-to-end view of the customer experience, enabling us to look at company-wide experience improvement areas. Whether that’s overall, or broken down e.g. by specific journey stages. Again, effort is a great metric to use here as you can map out friction areas (aka areas for improvement) across journey stages by channel, or intent. You can also view this by e.g. product or specific services, overlay churn risk or value segments, the list is endless. It should give you a clear idea where to focus your improvement efforts and track performance over time.
Many VoC tools can do parts of what I outlined here, but what we’re seeing now is a strong focus within our industry to mature our capabilities further, particularly in the conversational analytics space. It enables us to use the data we already have and use surveys only when we really need them. And that, in my humble opinion, is fantastic!
Thanks for “listening”.
