Title
A scalable pipeline data processing framework using database and visualization techniques
Abstract
Intelligent pipeline inspection gauges (PIGs) are inspection vehicles that move along within a gas (or oil) pipeline and acquire signals from their surrounding rings of sensors. By analyzing the signals captured by intelligent PIGs, we can detect pipeline defects, such as holes, curvatures and other potential causes of gas explosions. We notice that the size of collected data using a PIG is usually in GB range. Thus, analyzer software must handle such scalable data and provide various kinds of visualization tools so that analysts can easily detect any defects in the pipeline. In this paper, we propose a scalable pipeline data processing framework using database and visualization techniques. Specifically, we analyze requirements for our system, giving its overall architecture of our system. Second, we describe several important subsystems in our system: such as a scalable pipeline data store, integrated multiple visualization, and automatic summary report generator. Third, by performing experiments with GB-range real data, we show that our system is scalable to handle such large pipeline data. Experimental results show that our system outperforms a relational database management system (RDBMS) based repository by up to 31.9 times.
Year
DOI
Venue
2007
10.1007/978-3-540-74171-8_33
ICIC (1)
Keywords
Field
DocType
gb-range real data,intelligent pipeline inspection,pipeline defect,integrated multiple visualization,scalable data,relational database management system,visualization technique,large pipeline data,scalable pipeline data,scalable pipeline data store,time series data,data processing
Data processing,Visualization,Computer science,Software,Relational database management system,Spectrum analyzer,Database,Creative visualization,Scalability
Conference
Volume
ISSN
ISBN
4681
0302-9743
3-540-74170-4
Citations 
PageRank 
References 
0
0.34
1
Authors
8
Name
Order
Citations
PageRank
Wook-Shin Han180557.85
Soon Ki Jung232635.31
Jeyong Shin300.34
Jinsoo Lee41276.95
Mina Yoon500.34
Chang Geol Yoon630.93
Won Seok Seo730.93
Sang Ok Koo8144.25