Title
Silo: Predictable Message Latency in the Cloud
Abstract
Many cloud applications can benefit from guaranteed latency for their network messages, however providing such predictability is hard, especially in multi-tenant datacenters. We identify three key requirements for such predictability: guaranteed network bandwidth, guaranteed packet delay and guaranteed burst allowance. We present Silo, a system that offers these guarantees in multi-tenant datacenters. Silo leverages the tight coupling between bandwidth and delay: controlling tenant bandwidth leads to deterministic bounds on network queuing delay. Silo builds upon network calculus to place tenant VMs with competing requirements such that they can coexist. A novel hypervisor-based policing mechanism achieves packet pacing at sub-microsecond granularity, ensuring tenants do not exceed their allowances. We have implemented a Silo prototype comprising a VM placement manager and a Windows filter driver. Silo does not require any changes to applications, guest OSes or network switches. We show that Silo can ensure predictable message latency for cloud applications while imposing low overhead.
Year
DOI
Venue
2015
10.1145/2829988.2787479
Special Interest Group on Data Communication
Keywords
Field
DocType
guaranteed latency,latency SLA,network QoS,network calculus,traffic pacing
Computer science,Computer security,Queuing delay,Network packet,Computer network,Hypervisor,Filter driver,Network switch,Network calculus,Silo,Cloud computing,Distributed computing
Conference
Volume
Issue
ISSN
45
4
0146-4833
Citations 
PageRank 
References 
41
1.28
41
Authors
4
Name
Order
Citations
PageRank
Keon Jang176837.56
Justine Sherry250526.77
Hitesh Ballani3138663.25
Toby Moncaster4865.43