Paper Info
Title
The Large Scale Data Facility: Data Intensive Computing for Scientific Experiments
Abstract
The Large Scale Data Facility (LSDF) at the Karlsruhe Institute of Technology was started end of 2009 with the aim of supporting the growing requirements of data intensive experiments. In close cooperation with the involved scientific communities, the LSDF provides them not only with adequate storage space but with a directly attached analysis farm and -- more importantly -- with value added services for their big scientific data-sets. Analysis workflows are supported through the mixed Hadoop and Open Nebula Cloud environments directly attached to the storage, and enable the efficient processing of the experimental data. Metadata handling is a central part of the LSDF, where a metadata repository, community specific metadata schemes, graphical tools, and APIs were developed for accessing and efficiently organizing the stored data-sets.
Year
DOI
Venue
2011
10.1109/IPDPS.2011.286
IPDPS Workshops
Keywords
Field
DocType
karlsruhe institute,scientific experiments,involved scientific community,community specific metadata scheme,big scientific data-sets,analysis farm,adequate storage space,large scale data facility,experimental data,metadata repository,data intensive experiment,analysis workflows,data intensive computing,protocols,throughput,graphical tools,meta data,data visualization,microscopy,cloud computing,api,memory,data handling,computer graphics
Metadata,Metadata repository,Data-intensive computing,Meta Data Services,Data mapping,Computer science,Data element,Information repository,Database,Cloud computing
Conference
ISSN
ISBN
Citations 
1530-2075 E-ISBN : 978-0-7695-4577-6
978-0-7695-4577-6
3
PageRank 
References 
Authors
0.46
1
11
Name
Order
Citations
PageRank
Ariel O. Garcia130.46
Serguei Bourov282.16
Ahmad Hammad372.05
Jos van Wezel4226.02
Bernhard Neumair56818.71
Achim Streit61067109.13
Volker Hartmann7146.94
Thomas Jejkal8186.41
Patrick Neuberger961.33
Rainer Stotzka104517.89
van Wezel, J.1130.46