Data centre infrastructure: the emergence of DPUs in the enterprise data centre
Data Processing Units are about to move from hyperscale and HPC into the enterprise data centre and they could change far more than performance. By bringing firewalling, load balancing, micro-segmentation and telemetry directly to the switchport, DPUs promise simpler architectures, lower appliance costs, stronger visibility and a more sustainable data centre. This blog explores why DPUs matter, how they work, and why CIOs and CTOs should be paying attention now.
Understanding Data Processing Units (DPUs)
A DPU is a processor aimed at offloading infrastructure functions such as network, storage, and security from the CPU and GPUs on servers or network appliances. Typically, a DPU has its own dedicated CPU, memory, acceleration engine, and operating system. Several benefits should be immediately obvious.
- Offloading infrastructure functions can provide up to a 30% saving on the host CPU or GPU.
- The DPUs own processor is designed for specific infrastructure functions, which makes them more energy efficient.
- By running its own OS, a DPU will continue to function if the host OS fails.
A range of DPU form factors exist, but the most common for enterprise will be PCIe, Onboard, and System on a Chip (SoC). With PCIe, the DPU connects directly into the server’s PCIe bus like a standard NIC. Onboard DPUs connect into the server or appliance motherboard to save room on the PCIe bus. SoC is used on switches where the DPU is packaged with the switch silicon to effectively provide a DPU on each switchport.
In high-performance environments, server and network DPUs may work side by side. Server DPUs provide storage acceleration with features like NVMe-over-Fabrics (NVMe-oF), Zero Trust security, and hypervisor offload. Smart switch DPUs deliver network policy such as micro-segmentation, perimeter security, load balancing, NAT and telemetry.
DPU Hardware
The DPU market is complex but can be distilled to a small number of specialist silicon vendors that manufacture DPUs for server OEMs, network OEMs, hyperscalers, and service providers. Smart switching platforms pair DPU silicon with network operating systems and management software, while security and application-delivery ecosystems integrate DPU acceleration for policy enforcement, inspection, and telemetry.
The primary smart-switching platforms use integrated DPU architectures to provide network-services acceleration inside the switching fabric. A further category of DPU-enabled switches is aimed primarily at hyperscaler environments and is often associated with open networking software.
Several generations of DPU silicon are available, with newer designs improving power efficiency, performance, and feature depth. Current enterprise-class DPUs can support line-rate 400G services, while later-generation hardware can offer improved performance for functions such as Layer 3 to 4 filtering or deep packet inspection.
In smart switches, DPUs are integrated directly with the switching silicon. Backplane switching capacity and DPU services capacity are not always the same: switching throughput may run into multiple terabits, while the DPU complex provides a lower but still substantial services-throughput tier. Even so, the architecture can provide a cost-effective alternative to deploying separate network-services appliances. Typical specifications include the following.
- A compact 24-port smart-switch design may use four DPUs, around 128G of combined memory, and estimated network-services throughput of around 800G.
- A higher-density smart-switch design may use two newer-generation DPUs, around 128G of memory, and similar services throughput.
- Another 24-port design may use two DPUs and 64G of memory while offering around 800G of network-services throughput.
- A higher-capacity model may double the DPU count and increase memory to around 128G, providing up to 1.6T of network-services throughput.
Different switch designs can deliver similar services throughput with different numbers of DPUs. This is primarily due to how the DPUs are integrated into the switching chip, including the number and speed of internal links, though vendors may also measure and advertise performance differently.
DPU Use Cases
Finally, we will address the age-old CIO and CTO question of “so what?”. Aside from network and storage performance, the two most obvious use cases are Layer 3 to 7 network services and telemetry, provided via a centralised controller.
Modern DPUs provide traditional Layer 3 to 4 stateful firewalling, Layer 4 to 7 deep packet inspection, and application load balancing at a port level within the smart switch. In some cases, this capability can be delivered at a cost comparable to a standard Top of Rack (ToR) switch. This enables the removal of expensive high-end firewalls, load balancers, and micro-segmentation solutions, reducing complexity, cost, and Total Cost of Ownership (TCO).
We should all be aware of the benefits of analytics and telemetry, so I won’t make the case for them here. DPUs can provide flow-based telemetry, stateful connection tracking, and latency measurements. Having this information directly from the DPU in the switch is operationally invaluable and supports customer experience, security, compliance, and reduced TCO.
Some DPUs also support a P4 data pipeline. For anyone unfamiliar with P4, put simply it allows the vendor to re-programme the chip and change how the DPU handles packets. New capabilities can therefore be introduced far more rapidly, improving investment protection.
Over the next two to three years, we expect customers to realise the benefits of DPUs within their data centre environments. Designs will be simplified and costs reduced, while performance and security improve, with the bonus of better analytics and a more sustainable data centre.
Telecoms Programme activities
techUK brings together government, the regulator, telecom companies and stakeholders to help the UK maximise the benefits of adopting advanced communications services. We ensure our members have a clear understanding of market developments, customer requirements, and government priorities. Visit the programme page here.
Upcoming events
Latest news and insights
Learn more and get involved
Telecoms updates
Sign-up to get the latest updates and opportunities from our Communications Infrastructure and Services programme.
Meet the team
Tales Gaspar
Programme Manager, UK SPF and Satellite, techUK
Tales has a background in law and economics, with previous experience in the regulation of new technologies and infrastructure.
In the UK and Europe, he offered consultancy on intellectual property rights of cellular and IoT technologies and on the regulatory procedures at the ITU as a Global Fellow at the European Space Policy Institute (ESPI).
Tales has an LL.M in Law and Business by the Getulio Vargas Foundation (FGV) and an MSc in Regulation at the London School of Economics, with a specialization in Government and Law.
- Email:
- [email protected]
- Phone:
- +44 (0) 0207 331 2000
- Website:
- www.techUK.org
- LinkedIn:
- www.linkedin.com/in/talesngaspar
Read lessmore
Sophie Greaves
Associate Director, Digital Infrastructure, techUK
Sophie Greaves is Associate Director for Digital Infrastructure at techUK, overseeing the Telecoms Programme, the Data Centres Programme, and the UK Spectrum Policy Forum.
Sophie leads our work across telecoms networks, security and resilience, supply chain diversification, advanced communications technologies, spectrum policy, and data centres - bringing these areas together into a dedicated Digital Infrastructure unit. She was previously Head of Telecoms and Spectrum Policy.
Prior to joining techUK, Sophie completed a masters in Film Studies at University College London; her dissertation examined US telecoms policy relating to net neutrality and content distribution.
- Email:
- [email protected]
- Phone:
- 0207 331 2038
- LinkedIn:
- https://www.linkedin.com/in/sophiegreaves/,https://www.linkedin.com/in/sophiegreaves/
Read lessmore
Josh Turpin
Senior Programme Manager, Telecoms and Net Zero, techUK
Josh joined techUK as a Programme Manager for Telecoms and Net Zero in August 2024.
In this role, working jointly across the techUK Telecoms and Climate Programmes, Josh is responsible for leading on telecoms infrastructure deployment and uptake and supporting innovation opportunities, as well as looking at how the tech sector can be further utilised in the UK’s decarbonisation efforts.
Prior to joining techUK, Josh’s background was in public affairs and communications, working for organisations across a diverse portfolio of sectors including defence, telecoms and infrastructure; aiding clients through stakeholder engagement, crisis communications, media outreach as well as secretariat duties.
Outside of work, Josh has a keen interest in music, painting and sailing.
- Email:
- [email protected]
- Phone:
- 020 7331 2038
- LinkedIn:
- https://www.linkedin.com/in/josh-turpin/
Read lessmore
Authors
Stephen Hampton
CEO and Chief Architech, Starfish
