PEAK:AIO announced the release of a white paper detailing how a global tier-one vendor recently assessed a single PEAK:AIO AI Data Server and found it to surpass the recently published benchmarks of leading AI GPUDirect storage vendors. This result validates PEAK:AIO’s vision that AI is so fundamentally different that it needs not just new storage, but a completely new type of solution.
The rigorous testing employed a single latest-generation server of a top-tier vendor, equipped with 16 NVMe generation 4 drives. The focus of the initial tests was on PEAK:PROTECT, PEAK:AIO’s innovative parallelized RAID technology that serves as the backbone of the company’s AI Data Server. The tests successfully validated PEAK:AIO’s claim that its implementation of RAID6 could achieve read speeds comparable to RAID0 and scale with each drive. Impressively, the system delivered an outstanding 119GB/sec., harnessing the full potential of the 16 installed drives. This established the reference point for further tests.
While impressive, RAID performance in isolation only lays a foundation and creates a pot of potential performance which must navigate through various layers before becoming usable. PEAK:AIO excels in refining these layers, ensuring that the full RAID performance translates to real-world user applications, without the need for any proprietary tools or drivers.
Following the determination of maximum potential performance (119GBsec.), the test lab proceeded to configure a typical five-client solution utilizing PEAK:AIO’s implementation of NFS (RDMA based). Collectively, the five clients demonstrated the ability to sustain a total throughput of 118GB/sec. This result demonstrates the fastest single node storage server to-date, an indication of how finely tuned the PEAK:AIO layers are to present so little friction from RAID to user.
GPUDirect
Connected to a single Nvidia® DGX A100 via five 200Gbe / HDR ports, standard performance and GPUDirect tests were ran, both showing the same 118GB/sec. However, consecutive deep learning jobs run by Eyal Lemberger, PEAK:AIO’s CTO, showed GPUdirect providing a 20%-30% time improvement over non-GPUDirect workloads, demonstrating its real-life value as opposed to simple benchmark results.
“Until recently, the IT world has developed in incremental steps based on predictable roadmaps,” said Mark Klarzynski, CEO, PEAK:AIO. “AI has thoroughly disrupted this traditional approach. After observing storage vendors attempting to adapt to the evolving AI market by merely rebranding existing solutions as AI-specific, akin to trying to fit a square peg in a round hole. I believed that AI required and deserved a reset, a fresh perspective and new thinking to match its entirely new use of technology. “AI is changing futures; it deserves more than a force fit square peg. PEAK:AIO’s view is AI has unique demands and requires an entirely new approach to storage.”
PEAK:AIO’s previous performance of 80GB/sec. from a software driven standard server was groundbreaking until the performance engineer tested the parameters of the solution, to see if it could achieve even greater performance. In fact, the load on the CPU was not significant, leaving room for growth with the generation 5 NVMe drives coupled with ConnectX-7 cards and how they will perform when they are more available.
PEAK:AIO has strategically streamlined its AI software to take advantage of the full power of modern servers and CPUs as they evolve and seamlessly transforms a standard NVMe server into a blistering fast AI Data Server, delivering the performance of a $1 million plus HPC solution. This is achieved while maintaining the power efficiency of a single server and costing approximately $200 per terabyte. PEAK:AIO enables clients to direct their efforts and resources toward innovation instead of grappling with complex storage management.
