Name
Abstract | ||
|---|---|---|
Due to the increasing quality of instruments and availability of computational resources, the size of spatial scientific datasets has been steadily increasing. However, much of the research on efficient storage and access to spatial datasets has focused on large multidimensional arrays. In contrast, unstructured datasets consisting of collections of simplices (e.g. triangles or tetrahedra) present special challenges that have received less attention. Data values found at the vertices of the simplices may be dispersed throughout a datafile, producing especially poor disk locality. In this paper, we address this important problem of poor locality in two major ways. First, we reorganize the unstructured dataset to improve locality in both the dataset space and in the data file on disk using a specialized chunking approach that maintains the spatial neighborhood relationships inherent in the unstructured data. This reorganization produces significant gains in performance by reducing the number of accesses made to the data file. Second, we extend our previous work and describe a prefetching method that takes advantage of prior knowledge of the user's access pattern. Applying this prefetching method to unstructured data produces further performance gains over and above the gains seen from reorganization alone. |
Year | DOI | Venue |
|---|---|---|
2013 | 10.1109/BigData.2013.6691578 | Silicon Valley, CA |
Keywords | Field | DocType |
data handling,grid computing,storage management,computational resources,data values,datafile,datasets access,datasets storage,disk locality,iteration aware prefetching,prefetching method,spatial neighborhood relationships,spatial scientific datasets,specialized chunking approach,unstructured grids | Data mining,Locality,Grid computing,Vertex (geometry),Computer science,Theoretical computer science,Unstructured data,Chunking (psychology),Tetrahedron,Data file,Group method of data handling | Conference |
ISSN | Citations | PageRank |
2639-1589 | 4 | 0.39 |
References | Authors | |
12 | 2 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Oyindamola O. Akande | 1 | 4 | 0.39 |
| Philip J. Rhodes | 2 | 53 | 9.13 |