Title
(Re)design considerations for scalable large-file content distribution
Abstract
The CoBlitz system was designed to provide efficient large file transfer in a managed infrastructure environment. It uses a content distribution network (CDN) coupled with a swarm-style chunk distribution system to reduce the bandwidth required at origin servers. With 6 months of operation, we have been able to observe its behavior in typical usage, and glean information on how it could be redesigned to better suit its target audience. At its heart, this paper describes what happens when a plausible conceptual design meets the harsh realities of life on the Internet. We describe our experiences improving CoBlitz's performance via a range of techniques, including measurement-based feedback, heuristic changes, and new algorithms. In the process, we triple CoBlitz's performance, and we reduce the load it places on origin servers by a factor of five. In addition to improving performance for CoBlitz's users, we believe that our experiences will also be beneficial to other researchers working on large-file transfer and content distribution networks.
Year
Venue
Keywords
2005
WORLDS
design consideration,heuristic change,scalable large-file content distribution,coblitz system,large-file transfer,efficient large file transfer,content distribution network,swarm-style chunk distribution system,managed infrastructure environment,better suit,harsh reality,origin server
Field
DocType
Citations 
Conceptual design,Heuristic,Computer science,Server,Real-time computing,Target audience,Bandwidth (signal processing),File transfer,The Internet,Distributed computing,Scalability
Conference
3
PageRank 
References 
Authors
0.55
10
4
Name
Order
Citations
PageRank
Brian Biskeborn115914.85
Michael Golightly230.89
KyoungSoo Park3119873.47
Vivek Pai41532129.33