Title
Orchestrating safe streaming computations with precise control
Abstract
Streaming computing is a paradigm of distributed computing that features networked nodes connected by first-in-first-out data channels. Communication between nodes may include not only high-volume data tokens but also infrequent and unpredictable control messages carrying control information, such as data set boundaries, exceptions, or reconfiguration requests. In many applications, it is necessary to order delivery of control messages precisely relative to data tokens, which can be especially challenging when nodes can filter data tokens. Existing approaches, mainly data serialization protocols, do not exploit the low-volume nature of control messages and may not guarantee that synchronization of these messages with data will be free of deadlock. In this paper, we propose an efficient messaging system for adding precisely ordered control messages to streaming applications. We use a credit-based protocol to avoid the need to tag data tokens and control messages. For potential deadlocks caused by filtering behavior and global synchronization, we propose deadlock avoidance solutions and prove their correctness.
Year
DOI
Venue
2014
10.1109/PADSW.2014.7097925
ICPADS
Keywords
Field
DocType
credit-based protocol,parallel processing,protocols,control message delivery,data serialization protocols,data set boundaries,deadlock avoidance solutions,data tokens,messaging system,first-in-first-out data channels,distributed computing,parallel computing,filtering behavior,reconfiguration requests,global synchronization,streaming computation safety
Synchronization,Serialization,Computer science,Deadlock,Correctness,Filter (signal processing),Computer network,Communication channel,Real-time computing,Exploit,Control reconfiguration,Distributed computing
Conference
ISSN
Citations 
PageRank 
1521-9097
1
0.35
References 
Authors
7
4
Name
Order
Citations
PageRank
Peng Li18111.75
Kunal Agrawal268750.08
Jeremy Buhler382193.45
Roger D. Chamberlain461665.36