Title
Selective Scan for Filter Operator of SciDB.
Abstract
Recently there has been an increasing interest in analyzing scientific data generated by observations and scientific experiments. For managing these data efficiently, SciDB, a multi-dimensional array-based DBMS, is suggested. When SciDB processes a query with where predicates, it uses filter operator internally to produce a result array that matches the predicates. Most queries for scientific data analysis utilize spatial information. However, filter operator of SciDB reads all data without considering features of array-based DBMSs and spatial information. In this demo, we present an efficient query processing scheme utilizing characteristics of array-based data, implemented by employing coordinates. It uses a selective scan that retrieves data corresponding to a range that satisfies specific conditions. In our experiments, the selective scan is up to 30x faster than the original scan. We demonstrate that our implementation of the filter operator will reduce the processing time of a selection query significantly and enable SciDB to handle a massive amount of scientific data in more scalable manner.
Year
DOI
Venue
2016
10.1145/2949689.2949707
SSDBM
Field
DocType
Citations 
Query optimization,Spatial analysis,Data mining,Computer science,Operator (computer programming),Database,Scalability
Conference
0
PageRank 
References 
Authors
0.34
3
6
Name
Order
Citations
PageRank
Sangchul Kim120.70
Seoung Gook Sohn200.34
Tae-Hoon Kim345953.02
Jinseon Yu400.34
Bogyeong Kim511.83
B Moon62609235.33