by Adi Gaskell
Big data is arguably the most important trend in business today, and the companies that manage to capitalize on their data gain a distinct competitive advantage over their peers.
Unfortunately, the challenges faced in this endeavour are significant, with many organizations struggling to attract the data science skills required to thrive in the modern, data hungry world.
Whilst there are obviously issues surrounding the collection and cleaning of data, I want to focus today on the analysis and interpretation of it.
The shortage of data science capabilities is well known, and it’s resulted in a number of interesting projects that aim to “democratise” data analysis.
For instance, a team from MIT have taken an AI driven approach to the task. The researchers recently published a couple of papers on the process, including the preparation of data and even the creation of problem specifications.
“The goal of all this is to present the interesting stuff to the data scientists so that they can more quickly address all these new data sets that are coming in,” the authors say. “[Data scientists want to know] why don’t you show me the top 10 things that I can do the best, and then I’ll dig down into those? So [these methods are] shrinking the time between getting a data set and actually producing value out of it.”
Alternatively, new startups – like Information is Beautiful – are applying visualization techniques to make interpreting data easier.
The company, which was selected as one of Nesta’s “New Radicals” for 2016, has developed an Operational Control Centre app that aims to present data in a more accessible way.
The app aims to transform previously unmanageable data into usable information by displaying it in a visual and real-time way to both managers and clinicians. The app comes with a customizable dashboard so teams and organizations can gain access to the exact data they desire, whether that’s patient waiting time or the throughput of a particular department.
Bringing data to the masses
Very much in this ilk is Count Open, a recent graduate from the Accenture FinTech Innovation Lab. The company, started by a team of Cambridge graduates, aims to make it easy for non-technical employees to examine and analyze data sets.
The system uses natural language processing and aims to allow users to enter in natural language queries, with the system then mining a range of data to not only find the right answer, but to display the answer in the most effective format.
The desktop application is currently in beta mode, but the team are confident that it will open up the magic of data to people without the data science skills organizations crave.
“If we can get people 95% of the way there, it encourages more people to engage with data,” founder Oliver Hughes told me.
What’s more, the system is appealing because it works as well with messy data as it does with structured data. With so much of organizations current investment in data involved in the cleansing of it, this promises to be a particularly prominent selling point.
The ability to effectively interrogate data to make more informed decisions is undoubtedly of huge competitive importance for organizations of all types, and it’s pleasing to see a growing number of tools emerge that bring those kind of capabilities to a wider audience.
About the author
Adi Gaskell is an experienced innovator who has over 15 years experience across startups, government and industry. He has worked with organisations such as the NHS, Deloitte, Oracle, Dell, GSK, Leidos, Salesforce, DZone and The Government Office for Science. He is also a respected voice on technology and innovation, and pens regular pieces for publications such as the BBC and Forbes, as well as award winning whitepapers on innovation. His healthcare expertise has seen him judge healt-tech innovation competitions for the NHS, AXA PPP and Katerva, and he has recently contributed a chapter on the Future of Healthcare for a recent Kogan Page book. He also regularly speaks and moderates at industry leading events, including Health 2.0, EdTechX and The Guardian’s Public Sector Innovation, as well as appearing on BBC World Service and BBC Five Live.
Information is Beautiful by David McCandless
Knowledge Is Beautiful: Impossible Ideas, Invisible Patterns, Hidden Connections by David McCandless
The Truthful Art: Data, Charts, and Maps for Communication by Alberto Cairo
Storytelling with Data: A Data Visualization Guide for Business Professionals by Cole Nussbaumer Knaflic