The UK’s Big Data Future: Mind the Gap

  • techUK techUK
    Wednesday05Oct 2016

    techUK launches paper on ‘Understanding, Demystifying and Addressing the UK’s Big Data Skills Gap’.

Today techUK launched ‘Understanding, Demystifying and Addressing the UK’s Big Data Skills Gap’ which identified the eight key job roles and skills needed to implement a big data project, where the current skills gap exists and potential threats to combating the gap. It also makes a number of recommendations relating both to the domestic skills pipeline and the UK’s continued ability to attract some of the best talent from around the world.

Big data and data analytics will be a key pillar to the future of the UK’s Digital Economy. The big data revolution is expected to add £241 billion to UK GDP by 2020 as well as creating 157,000 additional jobs.

However, could all that be at risk? For the UK to turn potential into reality we need individuals with the skills and talent to design and implement big data and data analytics strategies. With the UK losing £2 billion from unfilled digital roles, this problem is not unique to big data and data analytics, but that market is expected to count for the largest proportion of vacancies.

The lack of big data and data analytics skills is putting at risk not just the potential contribution to UK GDP but the wider benefits of these tools and technologies to UK citizens.

It is therefore crucial that serious attempts are made to address the big data skills gap in the UK. To do so, there are some crucial questions we need to ask, and the answers may not be as clear as we thought.

First, what skills are actually required when implementing a big data strategy? The big data supply chain is vast and there are different skills required at different stages of delivering a project. We will never plug the skills gap simply by increasing one specific set of skills.

The UK needs skilled individuals able to build reliable big data platforms, as well as those who are able to identify and import relevant external data sets. Skills are required to bridge the gap between the business problem and the big data solution with an understanding of both, alongside technical analytical skills to use programmes to implement big data solutions. Algorithms need to be designed, trends identified and correlations investigated. Talent in relaying insights provided by data in an intelligible way to non-data experts is required, and someone needs to be in control of the overall strategy.

These are just a few of the skills required across the big data supply chain, highlighting the complex nature of the UK’s big data skills gap.

This leads us to the second key question. Where is gap in the UK’s Big Data skills? Which skills are missing and which do we actually have enough of? Is there a particular area where the UK lacks skilled individuals more than others? It seems to be frequently cited that the UK lacks data scientists, but is that the whole picture? Data scientists alone do not deliver entire Big Data strategies, there are others involved.

Before Government, industry and academia can take specific action to protect our current big data talent and develop a future talent pipeline, we must fully understand what skills are needed and where gaps exist.

To ensure this happens the techUK paper makes key recommendations to ensure the UK has the skills required to benefit from the big data revolution today and well into the future:

  • Data Analysts, Data Infrastructure Engineers and Solution Architects should feature prominently on any future Government preferred shortage occupation list, joining Data Scientists.
  • The UK’s existing tech workforce should be upskilled
  • The Department for Education must work to ensure there is more uptake of higher-level apprenticeships from a younger age with the forthcoming Apprenticeship Levy.
  • Programming and Analytics should be introduced earlier in the school curriculum.
  • Promote the value & importance of Big Data and Data Analytics to the UK’s economy and society in order to inspire future industry leaders.

The UK’s big data future is bright. To ensure it remains so, it is important that we have the talent required to support the delivery of the big data revolution.

For more information on our Big Data Skills work please contact:


Understanding Demystifying and Addressing the UKYs Big Da... (pdf)


Join us on 20 March as we welcome @Marthalanefox to techUK for the launch of new @OpenUniversity research on bridgi…
An Urgent and Emergency Care Forum is being created by @NHSDigital and @techUK - Suppliers interested in becoming f…
See how the UK compared to other countries in the @CTATech #innovationscorecard
What functions will our future energy system need to realise our #smartenergy ambitions? What does this mean for te…
.@techUK's @G_Derrington discusses the current concerns from industry when it comes to skills policy and Brexit in…
. @sagegroupplc & @Atos joined us today in supporting a new UK France digital conference announced today by @DCMS.…
Ruth Milligan, Head of Financial Services & Payments @techUK, debunks so pervasive myths around #OpenBanking and hi…