We use cookies to personalize your site experience.
Privacy policyMeet US at SDC 2024
September 16-18 | Hyatt Santa Clara, CA
Learn moreKIOXIA Corporation, formerly known as Toshiba Memory Corporation, is a leading global provider of flash memory solutions. Kioxia specializes in the design, development, and manufacturing of NAND flash memory products, including solid-state drives (SSDs), memory cards, and more.
KIOXIA has established itself as a pioneer and innovator in the semiconductor industry. The company's SSD drives are renowned for their high performance, reliability, and durability, making them ideal for a wide range of applications, from consumer electronics to enterprise storage systems.
Xinnor conducted a thorough testing phase on KIOXIA's CM7-V Series PCIe 5.0 NVMe mixed-use SSD. Equipped with 24 units of these SSDs, boasting impressive specs such as 14GB/s sequential read and 6.75GB/s sequential write speeds, along with a staggering 2.7 million IOPS for random read and over 600,000 IOPS for random write, these drives prove to be versatile powerhouses suitable for a range of applications, from high-performance computing (HPC) to artificial intelligence (AI) tasks.
In the testing setup, Xinnor utilized a Supermicro server outfitted with 2 AMD Genoa CPUs, each sporting 64 cores. To ensure optimal performance scalability and data integrity, we strategically configured the drives into 2 xiRAID groups, employing RAID level 5 across 12 drives per group. This configuration not only mitigates potential performance bottlenecks within NUMA nodes but also provides essential data protection in the event of a drive failure. As AI workloads increasingly blend random and sequential data access patterns, the robust performance demonstrated by xiRAID across various workloads underscores its efficacy in meeting the evolving demands of modern computing environments.
Test | Measured single drive performance | 2x RAID5 theoretical performance | xiRAID 2xRAID5 performance | Efficiency |
---|---|---|---|---|
4K Random Read (M IOPS) |
2.7 | 64.8 | 65 | 100% |
4K Random Write (M IOPS) |
0.7 | 8.0 | 8 | 100% |
Full Stripe Sequential read (GB/s) |
14 | 336 | 310.3 | 92% |
Full Stripe Sequential write (GB/s) |
6.75 | 149 | 144.5 | 97% |
We conducted comprehensive performance comparisons between different storage solutions, focusing on vHOST Kernel Target with Mdadm and SPDK vhost-blk target protected by Xinnor’s xiRAID Opus when using 10 KIOXIA CM7 drives.
Test | 1 VM Performance | Latency the lower, the better | Total Server Performance xiRAID: 14 VMs, mdraid: 16 VMs |
---|---|---|---|
select-only, xiraid | 110K tps | 0.9 ms | 1540K tps |
select-only, mdraid | 76K tps | 1.3 ms | 1216K tps |
select-only, xiraid, degraded mode |
112K tps | 0.9 ms | 1568K tps |
select-only, mdraid, degraded mode |
4.6K tps | 22 ms | 74K tps |
simple-update, xiraid | 26K tps | 3.8 ms | 364K tps |
simple-update, mdraid | 4.3K tps | 23 ms | 69K tps |
tpc-b-like, xiraid | 21K tps | 5 ms | 294K tps |
tpc-b-like, mdraid | 4K tps | 25 ms | 64K tps |
Drives: 10xKIOXIA KCMYXVUG3T20
CPU: Dual AMD EPYC 9534 64-Core Processors
OS: Ubuntu 22.04.3 LTS
PostgreSQL Version: 15
VMs: 14, with each using segmented RAID volumes as storage devices
When assessing different protection schemes, performance under both normal and degraded conditions is crucial. In select-only tests, xiRAID Opus outperforms mdraid by 30‑40%, with its ability to run the vhost target separately. In degraded mode, mdraid exhibits over 20 times slower performance than xiRAID, potentially leading to business losses, especially in time-sensitive sectors like online travel or trading. Moreover, mdraid's performance is six times worse than xiRAID Opus for small block writes and lags behind by five times in CPU-intensive operations like the TPC-B Like script. Overall, xiRAID ensures stable performance across multiple VMs, facilitating uninterrupted data access even during failures or heavy write loads. Additionally, its VM scalability enables administrators to consolidate servers, simplifying storage infrastructure and yielding substantial cost savings.
Read full whitepaperThe objective of the testing was to evaluate the applicability of software RAID arrays with high-performance NVMe drives for virtual machines requiring fast storage.
The extensive tests conducted in KIOXIA’s lab and reported in the whitepaper demonstrate that xiRAID Opus excels in random operations, showcasing exceptional performance with close to one million IOps per single CPU core and minimal latency. Its single-VM setup achieves latency levels below 100 microseconds, making it ideal for latency-sensitive applications. In random writes, xiRAID is four times faster than MDRAID, maintaining high performance even under heavy loads. In degraded mode, xiRAID Opus outperforms MDRAID by 20 times in read operations, showcasing minimal performance loss versus normal operation. This robustness ensures consistent performance, even in case of one or more drive failures.
In sequential operations, xiRAID maintains performance close to theoretical maximums, while MDRAID lags significantly behind. xiRAID's resilience makes it suitable for data-intensive applications, even in suboptimal conditions.
Read full whitepaper