Title
VTrace: Automatic Diagnostic System for Persistent Packet Loss in Cloud-Scale Overlay Network
Abstract
Persistent packet loss in the cloud-scale overlay network severely compromises tenant experiences. Cloud providers are keen to automatically and quickly determine the root cause of such problems. However, existing work is either designed for the physical network or insufficient to present the concrete reason of packet loss. In this paper, we propose to record and analyze the on-site forwarding condition of packets during packet-level tracing. The cloud-scale overlay network presents great challenges to achieve this goal with its high network complexity, multi-tenant nature, and diversity of root causes. To address these challenges, we present VTrace, an automatic diagnostic system for persistent packet loss over the cloud-scale overlay network. Utilizing the "fast path-slow path" structure of virtual forwarding devices (VFDs), e.g., vSwitches, VTrace installs several "coloring, matching and logging" rules in VFDs to selectively track the packets of interest and inspect them in depth. The detailed forwarding situation at each hop is logged and then assembled to perform analysis with an efficient path reconstruction scheme. Experiments are conducted to demonstrate VTrace's low overhead and quick responsiveness. We share experiences of how VTrace efficiently resolves persistent packet loss issues after deploying it in Alibaba Cloud for over 20 months.
Year
DOI
Venue
2020
10.1145/3387514.3405851
SIGCOMM '20: Annual conference of the ACM Special Interest Group on Data Communication on the applications, technologies, architectures, and protocols for computer communication Virtual Event USA August, 2020
DocType
ISBN
Citations 
Conference
978-1-4503-7955-7
4
PageRank 
References 
Authors
0.41
11
10
Name
Order
Citations
PageRank
Chongrong Fang1142.97
Haoyu Liu286.25
Mao Miao350.77
Jie Ye440.75
Lei Wang5133.97
Wansheng Zhang640.41
Daxiang Kang741.09
Biao Lyv840.41
Peng Cheng9148185.79
Jiming Chen104389238.91