Paper Info
Title
Networking Materials Data: Accelerating Discovery at Experimental Facilities.
Abstract
Advances in both sensor and computing technologies promise new approaches to discovery in materials science and engineering. For example, it appears possible to integrate theoretical modeling and experiment in new ways, test existing models with unprecedented rigor, and infer entirely new models from first principles. But, before these new approaches can become useful in practice, practitioners must be able to work with petabytes and petaflops as intuitively and interactively as they do with gigabytes and gigaflops today. The Discovery Engines for Big Data project at Argonne National Laboratory is tackling key bottlenecks along the end-to-end discovery path, focusing in particular on opportunities at Argonne's Advanced Photon Source. Here, we describe results relating to data acquisition, management, and analysis. For acquisition, we describe automated pipelines based on Globus services that link instruments, computations, and people for rapid and reliable data exchange. For management, we describe digital asset management solutions that enable the capture, management, sharing, publication, and discovery of large quantities of complex and diverse data, along with associated metadata and programs. For analysis, we describe the use of 100K+ supercomputer cores to enable new research modalities based on near-real-time processing and feedback, and the use of Swift parallel scripting to facilitate authoring, understanding, and reuse of data generation, transformation, and analysis software.
Year
DOI
Venue
2014
10.3233/978-1-61499-583-8-117
BIG DATA AND HIGH PERFORMANCE COMPUTING
Keywords
Field
DocType
Materials science,parallel computing,X-ray source,Swift,Globus
World Wide Web,Computer science
Conference
Volume
ISSN
Citations 
26
0927-5452
0
PageRank 
References 
Authors
0.34
0
8
Name
Order
Citations
PageRank
Foster Ian1229382663.24
Rachana Ananthakrishnan223228.57
Ben Blaiszik3315.73
Kyle Chard451556.70
Ray Osborn500.34
Steven Tuecke64625708.07
Michael Wilde735217.17
Justin M. Wozniak846435.32