contact Search

Analytics and big data - the big picture

Jon Bradbury

We look behind the buzz surrounding analytics and big data to shed light on what it really involves, why it’s different and the key challenges to making the most of it.

Big evolution 

We see analytics and big data as an evolution – a step on from business intelligence, which in turn evolved from traditional reporting. 

Of course, having good information to understand what’s going on in your business and run it successfully has always been important. The idea of information isn’t new, but the nature of it and its use and value has moved on a great deal. 

Increasingly, information is seen as a competitive tool to drive growth, not just a necessary tool to control and sustain a well-run business. 

An increasing part of the mix 

That’s not to say that analytics is taking over everything. Traditional reporting continues to be an important requirement and business intelligence has a valuable role to play, too. It’s a mix – one that’s determined by the needs and ambitions of each individual organization, but also one that increasingly is seeing the emphasis of energy, resources and value shift more towards analytics. 

So, what exactly is different about analytics? This is best answered by comparing it to its predecessors.

Traditional reporting focuses on pushing information in fixed formats to defined audiences. Monthly finance reports are a classic example. The emphasis is on capture and control. It’s static, historic, a matter of record. It’s essentially about the past – what’s happened. 

Business intelligence 
Business intelligence made static data more interactive. Fixed-format reports became interactive and online, with more ability to slice-and-dice, drill down and explore. Information became easier to digest with dashboards and other data visualization techniques. 

But the information was still essentially backward-looking, based on a defined area and amount of information – typically sourced from internal systems.

Analytics looks not only backwards but also forwards – considering the future. 

It often involves predictive models to show future scenario options, forecast the outcomes, and so help you understand how best to drive your business forward. It is inherently dynamic and its power and purpose lies in enabling you to use information far more effectively than ever before as a living operational and strategic tool. 

If traditional reporting is a rear view mirror, analytics is a head-up display. As such it’s front office and front of foot, with a strong bias to action – analyzing what-ifs to identify therefores. 

Moreover, the nature of the information is fundamentally different. It involves not only much larger volumes, hence the term big data, but also greater variety – looking not just at your business but at your customers’ data, for example. The data sources are more disparate and, often, externally sourced. So the net is cast far wider and more dynamically, with a great variety of unstructured data, such as social media, constantly streaming in. From a matter of record to a major strategic asset.

Evolution of analytics and big data

Three key differences at the heart of big data 

Tackling the challenges 

Big data clearly offers many great opportunities across both strategy and operations. But as we know from talking with senior information leaders across a variety of leading organizations, it also comes with a number of big challenges. 

These are the top issues on the minds of CIOs, CTOs, Heads of Analytics and other information leaders: 

Getting the balance right
The balance of build versus buy is discussed above, but another major challenge is how best to strike the right balance across traditional reporting, business intelligence and big data analytics. 

Many want to redirect effort (in both headcount and funding) away from reporting towards more analytics, but there may not be a simple way to do this. The skills sets and culture are very different, so you are unlikely to be able simply to re-use or re-assign the same people – it may require a deeper reorganization, which leads us to the second major challenge. 

Creating an effective organization structure for analytics
Big data can be a major headache when it comes to structuring your organisation. What kind of structure do you need? What sort of people should you employ? What skills and capabilities should they have? Where do you put them in the organization (should it be owned by Marketing, IT or neither)? 

One key insight here is that you shouldn’t expect to be able to do analytics well by simply re-using or extending your reporting team or your business intelligence center of excellence. The differences inherent in new data sources (as discussed below), typically require different skills, culture and management approaches. 

So you may well need to employ fresh people – such as data scientists, analytics operations experts, data visualization experts, and those with sufficient understanding of the statistical analysis fundamentals. 

And critically, you may be better off placing them with people at the sharp end of your business – your marketers, your supply chain experts, your product development whizzes, for example. Don’t put them in an information team silo; sit them side by side with business folk. That way, together, they’ll be able to make the most of big data’s great potential to drive insights and actions that transform your strategy and operations.

Old data versus new data
The information used for analytics and big data may be quite different to that used for traditional reporting, as illustrated below. That has a number of big implications beyond organizational and structure skills. 

For example, effort that is typically invested in cleansing, modelling, structuring and aligning data used for reporting may be better invested in innovative querying and insight generation techniques for analytics. 

Put simply, rather than spending a lot of effort tidying your loft so it is easy to find things, you might be better off simply paying someone who is very good at finding the things you want in a messy loft. The true value in analytics, however, may often come from combining old and new data sources.


Mobilizing and managing big data projects
Making a business case for investment in analytics is hard. By helping you find the questions you didn’t even know to ask as well as discover new, often counter-intuitive insights, it is by its very nature somewhat speculative. There may be gold in those hills, but it’s hard to say just how much before you start to dig. This makes it important to start small, demonstrate the value, and then be prepared to develop in many small, evolutionary steps. 

Analytics projects are different – inherently open-ended, iterative, fluid, hard to pin down and constantly evolving. The very scale and dynamism that makes big data so powerful can also create big headaches for traditional project management. And no one is ever forced to use an analytics solution purely to execute their business process – they have to want to use it because they see the value. 

All this means different management approaches are required together with the right change management. And focusing on end user take-up and value realization is essential.

Plotting your route 

There is no easy answer on plotting the best way forward with reporting, business intelligence, analytics and big data. 

We recommend developing an overall enterprise information roadmap that highlights which information capabilities will really drive value, and a rough timing and sequencing for developing them. 

We’d also recommend thinking as carefully about the organization structure and management approach for analytics as you would the technology and data approach. The order of development needs to take into account the underlying data dependencies as well as the business needs. Once the roadmap is set at a high level, the analytics capabilities need to have flexibility to iterate and evolve within that framework – but with just enough discipline and rigor to maintain control. 

Whatever course you plot should ultimately serve the aim of harnessing the power of information to reveal valuable insights and actions for your organization.