The UK’s Big Data Future: Mind the Gap

  • techUK techUK
    Wednesday05Oct 2016

    techUK launches paper on ‘Understanding, Demystifying and Addressing the UK’s Big Data Skills Gap’.

Today techUK launched ‘Understanding, Demystifying and Addressing the UK’s Big Data Skills Gap’ which identified the eight key job roles and skills needed to implement a big data project, where the current skills gap exists and potential threats to combating the gap. It also makes a number of recommendations relating both to the domestic skills pipeline and the UK’s continued ability to attract some of the best talent from around the world.

Big data and data analytics will be a key pillar to the future of the UK’s Digital Economy. The big data revolution is expected to add £241 billion to UK GDP by 2020 as well as creating 157,000 additional jobs.

However, could all that be at risk? For the UK to turn potential into reality we need individuals with the skills and talent to design and implement big data and data analytics strategies. With the UK losing £2 billion from unfilled digital roles, this problem is not unique to big data and data analytics, but that market is expected to count for the largest proportion of vacancies.

The lack of big data and data analytics skills is putting at risk not just the potential contribution to UK GDP but the wider benefits of these tools and technologies to UK citizens.

It is therefore crucial that serious attempts are made to address the big data skills gap in the UK. To do so, there are some crucial questions we need to ask, and the answers may not be as clear as we thought.

First, what skills are actually required when implementing a big data strategy? The big data supply chain is vast and there are different skills required at different stages of delivering a project. We will never plug the skills gap simply by increasing one specific set of skills.

The UK needs skilled individuals able to build reliable big data platforms, as well as those who are able to identify and import relevant external data sets. Skills are required to bridge the gap between the business problem and the big data solution with an understanding of both, alongside technical analytical skills to use programmes to implement big data solutions. Algorithms need to be designed, trends identified and correlations investigated. Talent in relaying insights provided by data in an intelligible way to non-data experts is required, and someone needs to be in control of the overall strategy.

These are just a few of the skills required across the big data supply chain, highlighting the complex nature of the UK’s big data skills gap.

This leads us to the second key question. Where is gap in the UK’s Big Data skills? Which skills are missing and which do we actually have enough of? Is there a particular area where the UK lacks skilled individuals more than others? It seems to be frequently cited that the UK lacks data scientists, but is that the whole picture? Data scientists alone do not deliver entire Big Data strategies, there are others involved.

Before Government, industry and academia can take specific action to protect our current big data talent and develop a future talent pipeline, we must fully understand what skills are needed and where gaps exist.

To ensure this happens the techUK paper makes key recommendations to ensure the UK has the skills required to benefit from the big data revolution today and well into the future:

  • Data Analysts, Data Infrastructure Engineers and Solution Architects should feature prominently on any future Government preferred shortage occupation list, joining Data Scientists.
  • The UK’s existing tech workforce should be upskilled
  • The Department for Education must work to ensure there is more uptake of higher-level apprenticeships from a younger age with the forthcoming Apprenticeship Levy.
  • Programming and Analytics should be introduced earlier in the school curriculum.
  • Promote the value & importance of Big Data and Data Analytics to the UK’s economy and society in order to inspire future industry leaders.

The UK’s big data future is bright. To ensure it remains so, it is important that we have the talent required to support the delivery of the big data revolution.

For more information on our Big Data Skills work please contact:


Understanding Demystifying and Addressing the UKYs Big Da... (pdf)


Great to see @gov_procurement being used to support #smes! Check out Rob Driver, head of public sector blog on anno…
How will the legal profession change with the AI revolution? Ben Allgrove from @bakermckenzie discusses potential c…
Many businesses experience barriers to using AI. @shanedavidrigby from @Atos gives advice to businesses wanting to…
Congratulations to our member @InformedTweet for receiving a Queen's Award for Innovation. #QueensAwards
All sectors can benefit from embracing AI - @SusanBowenUK from @CogecoPeer1 explains why: #AIReady
techUK's AI Week kicks off today! Throughout the week we will be bringing you news and views from the AI sector. Re…
Inviting tech companies large and small, from new players to established companies within the health and social car…
We need clarity from the Government over its decision to ban new applicants to CCAs. This could seriously impact th…