Clean data, smart state: why the UK public sector’s AI future starts with the back office
Gavin Sneddon
The UK public sector is rightly excited about the possibilities of advanced AI. From predictive AI, capable of identifying those families most at risk of homelessness, to agentic systems capable of handling multi-step tasks, the promise is substantial: faster and better-targeted services, reduced administrative burden, and better outcomes for citizens.
But there is an elephant in the (server) room! Much of the public sector’s data estate is simply not ready to be used in this way.
A fragmented data landscape
Across local government, health, policing, education and central government departments, critical datasets are there, but often sit in fragmented legacy systems, duplicated spreadsheets, departmental silos, bespoke databases, scanned PDFs, and legacy line-of-business applications serving narrow operational needs. In many organisations, data is not consistently structured, well-labelled, interoperable, or even readily extractable and machine-readability is almost never a given. In some cases, ownership and quality standards remain unclear and poorly documented. In others, while data governance may be strong now, that governance could not be applied retroactively, so, data that accumulated over decades is plagued with inconsistent formats, poor quality, duplication, and limited metadata.
This matters because advanced agentic AI asked to reason across multiple datasets, trigger workflows, draft decisions, or autonomously coordinate tasks needs clean, current and easily ingested data. If the underlying records are inaccurate or trapped in inaccessible systems, AI risks scaling up confusion rather than improving performance.
The challenge is particularly acute in the UK public sector because, since 2010, many organisations have been operating under severe financial pressure while carrying substantial technical debt. Replacing core systems is expensive. Migrating data is risky and operational teams are often too stretched to prioritise long-term data quality over immediate service delivery.
A different kind of AI opportunity
These challenges need not lead to despair as they also provide massive opportunities.
The next wave of public sector AI (moving beyond Copilot drafting and early predictive models) may not be autonomous digital workers. It may be, by necessity, the application of AI to the task of improving the data itself. While less visible, this task my ultimately prove more valuable in the long-term, since it is a key enabling step for better and more effective use of data by future AI and analytics models.
Modern AI tools can help classify unstructured records, identify duplicates, map fields between old and new systems, detect anomalies, standardise formats, extract information from scanned images. Used responsibly, AI can accelerate one of the hardest parts of digital transformation: understanding what data you have, where it sits, and how to make it usable.
That could be transformative for local authorities preparing for reorganisation, NHS bodies consolidating systems, departments modernising case management, or agencies seeking cross-organisational insights.
Governance remains critical
However, technology alone will not solve this. Governance remains critical. Public bodies need clear ownership of datasets, common standards, retention discipline, interoperability expectations in procurement, and realistic plans for legacy exit. Given the potential sensitivities of many of the key use cases, the correct frameworks for both security and privacy must be designed and built in from the beginning.
The real divide in public sector AI over the next few years may not be between organisations that adopt AI and those that do not. It may be between those that prepare their data estates and those that continue to defer the issue.
If Britain wants a smarter state, the path may begin somewhere less glamorous than frontier AI demos. It may begin with cleaning up the database and tagging the PDFs.
techUK - Transforming Public Services
techUK members are transforming public services in the UK. Our community help to shape a smarter, digitally empowered public sector.
techUK drives public sector digital transformation by uniting the public sector and tech industry. Through early market engagement, efficient procurement, and innovative technology adoption, we help to modernise legacy IT, and enable efficient, secure, and personalised services.
Get involved: We run a busy calendar of activity including events, reports, and insights that demonstrate some of the most significant digital transformation opportunities for the sector. Our Transforming Public Services Hub is where you will find details of all upcoming activities. We also send a monthly public services newsletter to which you can subscribe here.
Upcoming 'Transforming Public Services' events
Latest news and insights
More resources
Authors
