Title
Frugal Topology Construction For Stream Aggregation In The Cloud
Abstract
Aggregation of streamed data is key to the expansion of the Internet of Things. This paper addresses the problem of designing a topology for reliably aggregating data flows from many devices arriving at a datacenter. Reliability here means ensuring operation without data loss. We seek a frugal solution that prevents wasteful resource consumption (over-provisioning). This problem is salient when building an aggregation service out of components (here aggregation nodes) that exhibit hard constraints on the amount of information they can handle per unit of time. We first formalize the problem and provide an analysis of the relation between monitored devices (plus information they send), and the operations performed at aggregation nodes, in terms of data rates. Building on this rate analysis, we devise a novel algorithm, which we call C S A, that basically outputs an aggregation topology capable of handling those incoming data rates, preventing thereby empirical trial-and-error design. We analyze the algorithm, before validating it on the Amazon Kinesis platform, using a device dataset from a European telco operator.
Year
Venue
Field
2016
IEEE INFOCOM 2016 - THE 35TH ANNUAL IEEE INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATIONS
Resource consumption,Data loss,Computer science,Internet of Things,Topology construction,Computer network,Operator (computer programming),Salient,Cloud computing
DocType
ISSN
Citations 
Conference
0743-166X
0
PageRank 
References 
Authors
0.34
24
4
Name
Order
Citations
PageRank
Rachid Guerraoui16364430.90
Erwan Le Merrer232223.58
Rhicheek Patra3184.07
Bao Duy Tran4171.93