NVIDIA announced that
Dell Technologies, Hewlett Packard Enterprise and
Lenovo will be the first to integrate
NVIDIA Spectrum-X Ethernet
networking technologies for AI into their server lineups to help enterprise customers speed up generative AI workloads.
Purpose-built for generative AI, Spectrum-X offers enterprises a new
class of Ethernet networking that can achieve 1.6x higher networking
performance for AI communication versus traditional Ethernet offerings.
The new systems coming from three of the top system makers bring together Spectrum-X with NVIDIA Tensor Core GPUs, NVIDIA AI Enterprise software and NVIDIA AI Workbench software to provide enterprises the building blocks to transform their businesses with generative AI.
"Generative AI and accelerated computing are driving a generational
transition as enterprises upgrade their data centers to serve these
workloads," said Jensen Huang, founder and CEO of NVIDIA. "Accelerated
networking is the catalyst for a new wave of systems from NVIDIA's
leading server manufacturer partners to speed the shift to the era of
generative AI."
"Accelerated computing and networking are key to building systems to
meet the demands of large language models and generative AI
applications," said Michael Dell, chairman and CEO of Dell Technologies.
"Through our collaboration, Dell Technologies and NVIDIA are providing
customers with the infrastructure and software needed to quickly and
securely extract intelligence from their data."
"Generative AI will undoubtedly drive innovation across multiple
industries," said Antonio Neri, president and CEO of HPE. "These
powerful new applications will require a fundamentally different
architecture to support a variety of dynamic workloads. To enable
customers to realize the full potential of generative AI, HPE is
partnering with NVIDIA to build systems with the required power,
efficiency and scalability to support these applications."
"Generative AI can power unprecedented transformation but places
unprecedented demands on enterprise infrastructure," said Yuanqing Yang,
chairman and CEO of Lenovo. "Working closely with NVIDIA, Lenovo is
building efficient, accelerated systems with the networking, computing
and software needed to power modern AI applications."
Networking Purpose-Built to Accelerate AI
For peak AI workload efficiency, Spectrum-X combines the extreme performance of the Spectrum-4 Ethernet switch; the NVIDIA BlueField-3 SuperNIC, a new class of network accelerators for supercharging hyperscale AI workloads; as well as acceleration software. Spectrum-X complements BlueField-3 DPUs, the world's most advanced infrastructure computing platform.
Spectrum-4 is the world's first 51Tb/sec Ethernet switch for AI,
providing highly effective data throughput at scale and under load while
minimizing network congestion for multi-tenant, AI cloud workloads. Its
intelligent, fine-tuned routing technology enables maximum utilization
of network infrastructure at all times.
BlueField-3 SuperNICs are designed for network-intensive, massively
parallel computing, offering up to 400Gb/s RDMA over Converged Ethernet
(RoCE) network connectivity between GPU servers and boosting performance
for AI training and inference traffic on the east-west network inside
the cluster. They also enable secure, multi-tenant data center
environments, ensuring deterministic and isolated performance between
tenant jobs. Boasting a power-efficient, half-height, half-length PCIe
form factor, BlueField-3 SuperNICs are ideal for enterprise-class
servers.
Acceleration software powering Spectrum-X features NVIDIA software development kits such as Cumulus Linux, Pure SONiC and NetQ - which together drive the platform's breakthrough performance - and the NVIDIA DOCA software framework, which is at the heart of BlueField.
NVIDIA AI Enterprise provides frameworks, pretrained models and
development tools for secure, stable and supported production AI. NVIDIA
AI Workbench allows developers to quickly create, test and customize
pretrained generative AI models on a PC or workstation - then scale them
to virtually any data center or cloud.
NVIDIA Israel-1 Supercomputer Powered by Spectrum-X
Spectrum-X also enables the NVIDIA Israel-1 supercomputer, a reference
architecture for next-generation AI systems. Israel-1 is a collaboration
with Dell Technologies, using Dell PowerEdge XE9680 servers powered by
the NVIDIA HGXTM H100 eight-GPU platform and BlueField-3 DPUs and
SuperNICs with Spectrum-4 switches.
Availability
New systems from Dell, HPE and Lenovo featuring the complete NVIDIA AI stack are expected in the first quarter of next year.