Title
Labeled Network Stack - A Co-designed Stack for Low Tail-Latency and High Concurrency in Datacenter Services.
Abstract
Many Internet, mobile Internet, and IoT services require both low tail-latency and high concurrency in datacenters. The current protocol stack design pays more attention to throughput and average performance, considering little on tail latency and priority. We address this question by proposing a hardware-software co-designed Labeled Network Stack (LNS) for future datacenters. The key innovation is a payload labeling mechanism that distinguishes data packets in a TCP link across the full network stack, including the application, the TCP/IP and the Ethernet layer. This design enables prioritized data packets processing and forwarding along the full data path, to reduce the tail latency of critical requests. We built a prototype datacenter server to evaluate the LNS design against a standard Linux kernel stack and the mTCP research, using IoT kernel benchmark MCC. Experiment results show that the LNS design can provide an order of magnitude improvement on tail latency and concurrency.
Year
DOI
Venue
2018
10.1007/978-3-030-05677-3_12
NPC
Field
DocType
Citations 
Computer science,Latency (engineering),Concurrency,Network packet,Computer network,Ethernet,Throughput,Protocol stack,The Internet,Linux kernel
Conference
1
PageRank 
References 
Authors
0.35
5
5
Name
Order
Citations
PageRank
Wenli Zhang111.02
Ke Liu22016.97
Hui Song329928.95
Lan Yu421.73
Ming-yu Chen590279.29