Title
EndRE: an end-system redundancy elimination service for enterprises
Abstract
In many enterprises today, WAN optimizers are being deployed in order to eliminate redundancy in network traffic and reduce WAN access costs. In this paper, we present the design and implementation of EndRE, an alternate approach where redundancy elimination (RE) is provided as an end system service. Unlike middleboxes, such an approach benefits both end-to-end encrypted traffic as well as traffic on last-hop wireless links to mobile devices. EndRE needs to be fast, adaptive and parsimonious in memory usage in order to opportunistically leverage resources on end hosts. Thus, we design a new fingerprinting scheme called SampleByte that is much faster than Rabin fingerprinting while delivering similar compression gains. Unlike Rabin fingerprinting, SampleByte can also adapt its CPU usage depending on server load. Further, we introduce optimizations to reduce server memory footprint by 33-75% compared to prior approaches. Using several terabytes of network traffic traces from 11 enterprise sites, testbed experiments and a pilot deployment, we show that EndRE delivers 26% bandwidth savings on average, processes payloads at speeds of 1.5- 4Gbps, reduces end-to-end latencies by up to 30%, and translates bandwidth savings into equivalent energy savings on mobile smartphones.
Year
Venue
Keywords
2010
NSDI
rabin fingerprinting,approach benefit,new fingerprinting scheme,end-to-end encrypted traffic,wan access cost,cpu usage,alternate approach,end-system redundancy elimination service,network traffic trace,network traffic,wan optimizers,mobile device
Field
DocType
Citations 
CPU time,Computer science,Computer network,Testbed,Real-time computing,Encryption,Mobile device,Redundancy (engineering),WAN optimization,End system,Memory footprint,Distributed computing
Conference
73
PageRank 
References 
Authors
3.13
14
8
Name
Order
Citations
PageRank
Bhavish Aggarwal11286.54
Aditya Akella24138268.44
Ashok Anand3116467.77
Athula Balachandran440918.17
Pushkar Chitnis5834.08
Chitra Muthukrishnan623211.90
R. Ramjee73180299.73
George Varghese88149727.66