Title
Scale and performance in the CoBlitz large-file distribution service
Abstract
Scalable distribution of large files has been the area of much research and commercial interest in the past few years. In this paper, we describe the CoBlitz system, which efficiently distributes large files using a content distribution network (CDN) designed for HTTP. As a result, CoBlitz is able to serve large files without requiring any modifications to standard Web servers and clients, making it an interesting option both for end users as well as infrastructure services. Over the 18 months that CoBlitz and its partner service, CoDeploy, have been running on PlanetLab, we have had the opportunity to observe its algorithms in practice, and to evolve its design. These changes stem not only from observations on its use, but also from a better understanding of their behavior in real-world conditions. This utilitarian approach has led us to better understand the effects of scale, peering policies, replication behavior, and congestion, giving us new insights into how to better improve their performance. With these changes, CoBlitz is able to deliver in excess of 1 Gbps on PlanetLab, and to outperform a range of systems, including research systems as well as the widely-used BitTorrent.
Year
Venue
Keywords
2006
NSDI
research system,infrastructure service,coblitz system,large file,end user,better understanding,content distribution network,commercial interest,replication behavior,scalable distribution,coblitz large-file distribution service,bittorrent
Field
DocType
Citations 
PlanetLab,End user,Computer science,Distribution networks,Computer network,BitTorrent,Peering,Web server,Scalability,Distributed computing
Conference
67
PageRank 
References 
Authors
3.28
21
2
Name
Order
Citations
PageRank
KyoungSoo Park1119873.47
Vivek Pai21532129.33