Allow me to take a contrarian view to the rapid interest in applying analytics. Have we seen this kind of story before? Is there a rush to judgment that analytics is the elusive cure-all magic potion or panacea that management has been seeking to achieve extraordinary high performance?
Don’t misinterpret me. I am a big advocate of analytics and excited that it is enjoying a big buzz. My 1971 undergraduate degree was in operations research, so I have been waiting over 40 years to witness attention and attraction to analytics as a vital capability and discipline. However, during my career I have observed past management fads appear and managers’ desire to jump on new bandwagons only to see them fade away as a temporary craze rather than to have sustained use.
Some journalists are already questioning one aspect of analytics – Big Data that some uses of analytics rely on as a source. For example, a recent New York Times article was titled, “Is Big Data an Economic Big Dud?”
Imagine if we reviewed the titles and content of New York Times best-selling business books or Harvard Business Review articles from the last 20 years. For how many of them might we react with a chuckle and say, “Oh, that one”? Do you remember any of these that rose in prominence only to become relatively obscure? (Warning: some advocates or book authors may be offended.)
This is not to say that the practices listed above served no purpose. They did introduce useful ideas, but they did not live up to their promises as they ascended. Many organizations jump from improvement program to program hoping that each new one may provide that big yet elusive competitive edge like a magic pill only to discover with hindsight it was just a method du jour. Most managers would acknowledge that pulling one lever for improvement rarely results in a substantial change – particularly a long-term sustained change. And the business media has not helped. They hype what is fashionable at the time in large part because that is their role.
For many reasons my bet is that analytics is a keeper with staying power. The standard reasons from advocates involve the recent recognition of Big Data characterized with its six “Vs” of volume, velocity, volatility, variety, validity and value. Another reason is that quantitative analysis has demonstrated benefits in non-business areas like medicine, astronomy or oil and gas exploration.
I believe there are other reasons that analytics will be embraced. One is that the obvious low-hanging fruit opportunities for improvement have already been picked. Organizations have to be more clever about identifying opportunities to gain a competitive edge. Another reason is that gut feel and intuition are no longer sufficient given the increasing complexity, volatility and uncertainty involved in managing an enterprise. Fact-based information is needed. Another reason is the computing power, data and software is now available to dig deeper to gain insight and foresight.
A final reason is that the margin for decision errors is getting slimmer. In the past an organization could make a few bad decisions and survive. There were usually enough buffers to get by such as carrying excessive inventories and long order lead times to cover mistakes. In 1985, the Coca-Cola Co. survived its ill-fated experiment with New Coke. Two Clairol shampoos, Look of Buttermilk and Touch of Yogurt, were decisively rejected by consumers who did not relate to putting something in their hair that might be food, but the company recovered.
I do not have a crystal ball. I am often a skeptic. I wonder if analytics will stand the test of time. It is the shiny new toy now. Will it last?
There are barriers that are slowing the adoption rate to apply analytics. They mainly involve natural resistance to change with people. People like the status quo. The main barrier to the acceptance of applying analytics is no longer technical but rather is behavioral and cultural. The software tools are proven. The use of analytics by casual users, not just a team of trained statisticians, is becoming widespread. We now hear the term “data scientist.”
A better understanding of data at a very deep level can make a big difference. Low-level analytics just won’t get you there. Organizations face complex challenges where advanced signal detection capabilities are critical. Analytics is no fad. It is a serious competitive advantage.
The key for improving is integrating and balancing multiple enterprise and corporate performance management (EPM/CPM) improvement methods and spicing each of them with analytics of all flavors such as correlation, regression, segmentation and clustering. And keep your eye on the expansion upward from descriptive, diagnostic and predictive analytics to prescriptive analytics – the golden ring with optimixation. In the end, organizations need top-down guidance from the C-suite with bottom-up execution and analytics for insights and foresight.