Paper Info
Title
Joint Operator Replication and Placement Optimization for Distributed Streaming Applications
Abstract
In the last few years, several processing approaches have emerged to deal with Big Data. Exploiting on-the-fly computation, Data Stream Processing (DSP) applications can process unbounded streams of data to extract valuable information in a near real-time fashion. To keep up with the high volume of daily produced data, the operators that compose a DSP application can be replicated and placed on multiple, possibly distributed, computing nodes, so to process the incoming data flow in parallel. In this paper, we present Optimal DSP Replication and Placement (ODRP), a unified general formulation of the operator replication and placement problem that takes into account the heterogeneity of application requirements and infrastructural resources. A key feature of ODRP is the joint optimization of the operators replication and their placement. We evaluate the proposed model through a set of numerical experiments that demonstrates its flexibility and the benefits that derive from the joint optimization.
Year
DOI
Venue
2016
10.4108/eai.25-10-2016.2266628
VALUETOOLS
Field
DocType
ISBN
Digital signal processing,Data stream processing,Computer science,Real-time computing,Operator (computer programming),Big data,Computation,Data flow diagram,Distributed computing
Conference
978-1-63190-141-6
Citations 
PageRank 
References 
1
0.35
0
Authors
4
Name
Order
Citations
PageRank
Valeria Cardellini11514106.12
Vincenzo Grassi2174681.24
Francesco Lo Presti3107378.83
Matteo Nardelli4777.95