With a challenge of improving performance in accessing its archival storage platform, Karlsruhe Institute of Technology (KIT) has run through a rigorous testing of xiRAID, a cutting-edge software RAID solution developed by Xinnor. In comparison with other solutions xiRAID showed outstanding performance drastically outperforming other setups.
HPSS (High Performance Storage System) is operated at Karlsruhe Institute of Technology (KIT) as a storage platform for archival storage on magnetic tapes mainly for the Grid Computing Center Karlsruhe (GridKa) (www.gridka.de) and the bwDataArchive (rda.kit.edu) service.
HPSS is currently based on 3 tape libraries storing more than 100 petabytes distributed over 2 sites. Managing such large pool of data on tapes requires proper implementation of a cache for both writing and reading.
After testing two systems, one based on HDDs and one based on SSDs, KIT came to the conclusion that those systems do not offer expected stable performance due to limitations of their internal architecture. These trials highlighted the need for a system offering low latency, high throughput and storage redundancy. To cope with these requirements, KIT took a bold step by evaluating xiRAID, renowned for its ability to deliver exceptional performance and reliability with NVMe drives.
The testing configuration featured a standard server equipped with an AMD Epyc 9954P processor boasting 64 cores, 512GB of DRAM, and 10 Micron 9400 NVMe SSDs, each with a capacity of 30TB. It also included 4x100Gbit/s Ethernet links and Xinnor’s xiRAID in RAID6 configuration with multiple logical volumes (LV). Following the RAID setup, the usable storage capacity was to 240TB. Notably, this RAID setup ensures the system can withstand the failure of up to 2 out of the 10 drives, offering assurance in terms of reliability and data integrity.
Through rigorous testing, KIT’s benchmark results shattered expectations. The NVMe SSD-based solution powered by xiRAID consistently achieved read speeds exceeding 50GB/s and write speeds surpassing 25GB/s. These unprecedented performance levels outperformed previous storage systems by a wide margin.
To learn more about testing and its results visit: https://xinnor.io/partners-resellers/
The success of KIT’s xiRAID testing not only underscores the institute’s commitment to innovation but also highlights the transformative potential of software-defined storage solutions. KIT’s experiments to identify the best cache for their Tape libraries highlight the efficiency of a setup utilizing a standard x86 server with local NVMe storage, safeguarded by Xinnor’s xiRAID. This solution demonstrates impressive and consistent performance at minimal power consumption and a notably lower cost compared to alternative options explored by KIT. With xiRAID ensuring data integrity, the solution effectively meets the performance requirements for operating the cache tier.
ABOUT KARLSRUHE INSTITUTE OF TECHNOLOGY
The Karlsruhe Institute of Technology (KIT), a pioneering institution in Germany, was established in 2009 through the historic merger of the University of Karlsruhe and the Karlsruhe Research Center. As the first of its kind in Germany, this integration seamlessly combines academic and non-academic entities, reshaping the scientific and research landscape. Functioning as a national research center under the Helmholtz Association, KIT leads cutting-edge research across diverse fields, positioning itself at the forefront of innovation. Its membership in TU9 underscores its academic excellence, standing alongside Germany’s largest and most distinguished institutes of technology.
