Title | ||
---|---|---|
A scalable pipeline data processing framework using database and visualization techniques |
Abstract | ||
---|---|---|
Intelligent pipeline inspection gauges (PIGs) are inspection vehicles that move along within a gas (or oil) pipeline and acquire signals from their surrounding rings of sensors. By analyzing the signals captured by intelligent PIGs, we can detect pipeline defects, such as holes, curvatures and other potential causes of gas explosions. We notice that the size of collected data using a PIG is usually in GB range. Thus, analyzer software must handle such scalable data and provide various kinds of visualization tools so that analysts can easily detect any defects in the pipeline. In this paper, we propose a scalable pipeline data processing framework using database and visualization techniques. Specifically, we analyze requirements for our system, giving its overall architecture of our system. Second, we describe several important subsystems in our system: such as a scalable pipeline data store, integrated multiple visualization, and automatic summary report generator. Third, by performing experiments with GB-range real data, we show that our system is scalable to handle such large pipeline data. Experimental results show that our system outperforms a relational database management system (RDBMS) based repository by up to 31.9 times. |
Year | DOI | Venue |
---|---|---|
2007 | 10.1007/978-3-540-74171-8_33 | ICIC (1) |
Keywords | Field | DocType |
gb-range real data,intelligent pipeline inspection,pipeline defect,integrated multiple visualization,scalable data,relational database management system,visualization technique,large pipeline data,scalable pipeline data,scalable pipeline data store,time series data,data processing | Data processing,Visualization,Computer science,Software,Relational database management system,Spectrum analyzer,Database,Creative visualization,Scalability | Conference |
Volume | ISSN | ISBN |
4681 | 0302-9743 | 3-540-74170-4 |
Citations | PageRank | References |
0 | 0.34 | 1 |
Authors | ||
8 |
Name | Order | Citations | PageRank |
---|---|---|---|
Wook-Shin Han | 1 | 805 | 57.85 |
Soon Ki Jung | 2 | 326 | 35.31 |
Jeyong Shin | 3 | 0 | 0.34 |
Jinsoo Lee | 4 | 127 | 6.95 |
Mina Yoon | 5 | 0 | 0.34 |
Chang Geol Yoon | 6 | 3 | 0.93 |
Won Seok Seo | 7 | 3 | 0.93 |
Sang Ok Koo | 8 | 14 | 4.25 |