Paper Info
Title
Progressive Retrieval And Hierarchical Visualization Of Large Remote Data
Abstract
The size of data sets produced on remote supercomputer facilities frequently exceeds the processing capabilities of local visualization workstations. This phenomenon increasingly limits scientists when analyzing results of large-scale scientific simulations. That problem gets even more prominent in scientific collaborations, spanning large virtual organizations, working on common shared sets of data distributed in Grid environments. In the visualization community, this problem is addressed by distributing the visualization pipeline. In particular, early stages of the pipeline are executed on resources closer to the initial (remote) locations of the data sets.This paper presents an efficient technique for placing the first two stages of the visualization pipeline (data access and data filter) onto remote resources. This is realized by exploiting the "extended retrieve" feature of GridFTP for flexible, high performance access to very large HDF5 files. We reduce the number of network transactions for filtering operations by utilizing a server side data processing plugin, and hence reduce latency overhead compared to GridFTP partial file access. The paper further describes the application of hierarchical rendering techniques on remote uniform data sets, which make use of the remote data filtering stage.
Year
DOI
Venue
2005
10.12694/scpe.v6i3.337
SCALABLE COMPUTING-PRACTICE AND EXPERIENCE
Field
DocType
Volume
Server-side,Hierarchical Data Format,Data processing,Visualization,Computer science,Workstation,Real-time computing,GridFTP,Rendering (computer graphics),Data access,Distributed computing
Journal
6
Issue
ISSN
Citations 
3
1895-1767
6
PageRank 
References 
Authors
0.47
7
7
Name
Order
Citations
PageRank
Hans-Christian Hege11319102.92
Andrei Hutanu214514.96
Ralf Kähler3575.16
André Merzky427341.56
Thomas Radke535548.26
E. Seidel654682.53
Brygg Ullmer73263600.88