Load-aware transmission mechanism for NVMeoF storage networks

Xinghan Qiao; Xuchao Xie; Liquan Xiao

doi:10.1117/12.2628060

18 February 2022 Load-aware transmission mechanism for NVMeoF storage networks

Xinghan Qiao, Xuchao Xie, Liquan Xiao

Proceedings Volume 12162, International Conference on High Performance Computing and Communication (HPCCE 2021); 121620H (2022) https://doi.org/10.1117/12.2628060
Event: 2021 International Conference on High Performance Computing and Communication, 2021, Guangzhou, China

Abstract

NVMe over TCP is a key technology for building large-scale high-performance storage systems. It can realize NVMeoF (NVMe over Fabrics) storage network based on existing data center network infrastructure and standard TCP/IP software protocol stack. In this paper, we design and implement the Load-aware NVMeoF message processing mechanism LANoT (Load-aware NVMe over TCP). Firstly, the interrupt coalescing technology based on PDU aggregation is used to alleviate the interrupt storm problem and achieve high throughput. Secondly, matching the special message processing mechanism, which can effectively improve the key performance indicators according to the I/O characteristics of different dedicated queues. This paper implements the LANoT prototype system in Linux kernel. The performance test results show that comparing to NVMe over TCP implementation in standard Linux kernel, LANoT can significantly improve IOPS metrics and reduce CPU resource consumption by more than 50%.

Citation Download Citation

Xinghan Qiao, Xuchao Xie, and Liquan Xiao "Load-aware transmission mechanism for NVMeoF storage networks", Proc. SPIE 12162, International Conference on High Performance Computing and Communication (HPCCE 2021), 121620H (18 February 2022); https://doi.org/10.1117/12.2628060

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available