Paper Info
Title
Incast Mitigation in a Data Center Storage Cluster Through a Dynamic Fair-Share Buffer Policy.
Abstract
Incast is a phenomenon when multiple devices interact with only one device at a given time. Multiple storage senders overflow either the switch buffer or the single-receiver memory. This pattern causes all concurrent-senders to stop and wait for buffer/memory availability, and leads to a packet loss and retransmission-resulting in a huge latency. We present a software-defined technique tackling the manyto-one communication pattern-Incast-in a data center storage cluster. Our proposed method decouples the default TCP windowing mechanism from all storage servers, and delegates it to the software-defined storage controller. The proposed method removes the TCP saw-tooth behavior, provides a global flow awareness, and implements the dynamic fair-share buffer policy for end-to-end I/O path. It considers all I/O stages (applications, device drivers, NICs, switches/routers, file systems, I/O schedulers, main memory, and physical disks) while achieving the maximum I/O throughput. The policy, which is part of the proposed method, allocates fair-share bandwidth utilization for all storage servers. Priority queues are incorporated to handle the most important data flows. In addition, the proposed method provides better manageability and maintainability compared with traditional storage networks, where data plane and control plane reside in the same device.
Year
DOI
Venue
2019
10.1109/ACCESS.2019.2891264
IEEE ACCESS
Keywords
Field
DocType
Incast,software-defined storage,I/O throughput,dynamic fair-share buffer,end-to-end I/O path,fair-share BW utilization
Forwarding plane,Control theory,Computer science,Latency (engineering),Server,Packet loss,Computer network,Priority queue,Throughput,Data center,Distributed computing
Journal
Volume
ISSN
Citations 
7
2169-3536
0
PageRank 
References 
Authors
0.34
0
5
Name
Order
Citations
PageRank
Yawar Bangash1122.27
Tauseef Rana200.34
Haider Abbas339143.88
Muhammad Ali Imran42920278.27
Adnan Ahmed Khan5287.09