Paper Info
Title
Toward integrating overlay and physical networks for robust parallel processing architecture.
Abstract
Recently, much research attention is being paid toward the wide-area parallel processing architectures whereby all the network devices in the entire network execute the processing function in order to shorten the completion time of big data mining tasks. Despite some advancement, such architectures still suffer from physical network failures, which lead to critical service unavailability. As a remedy to this problem, an overlay-based parallel processing architecture, where nodes manage each other by employing the overlay network, can achieve higher service availability against small-scale failures. However, the overlay-based parallel processing architecture is not capable of providing data mining services in case large-scale network failures disrupt the overlay network. To deal with this issue, our article introduces a design methodology of an overlay-based parallel processing architecture based on integration of overlay and physical networks. Additionally, we introduce basic principles based on the design methodology. Through numerical calculation, we evaluate the effectiveness of an integration approach on the performance of parallel data processing in terms of higher service availability against physical network failures while minimizing traffic load.
Year
DOI
Venue
2014
10.1109/MNET.2014.6863130
IEEE Network
Keywords
DocType
Volume
Overlay networks,Parallel processing,Data mining,Telecommunication traffic,Computer architecture,Data processing,Design methodology
Journal
28
Issue
ISSN
Citations 
4
0890-8044
1
PageRank 
References 
Authors
0.39
0
6
Name
Order
Citations
PageRank
Katsuya Suto112211.03
Hiroki Nishiyama2128592.61
Nei Kato33982263.66
takayuki nakachi45216.65
Tatsuya Fujii5397.95
takahara613218.65