Title
Bio-swarm-pipeline: a light-weight, extensible batch processing system for efficient biomedical data processing.
Abstract
A streamlined scientific workflow system that can track the details of the data processing history is critical for the efficient handling of fundamental routines used in scientific research. In the scientific workflow research community, the information that describes the details of data processing history is referred to as "provenance" which plays an important role in most of the existing workflow management systems. Despite its importance, however, provenance modeling and management is still a relatively new area in the scientific workflow research community. The proper scope, representation, granularity and implementation of a provenance model can vary from domain to domain and pose a number of challenges for an efficient pipeline design. This paper provides a case study on structured provenance modeling and management problems in the neuroimaging domain by introducing the Bio-Swarm-Pipeline. This new model, which is evaluated in the paper through real world scenarios, systematically addresses the provenance scope, representation, granularity, and implementation issues related to the neuroimaging domain. Although this model stems from applications in neuroimaging, the system can potentially be adapted to a wide range of bio-medical application scenarios.
Year
DOI
Venue
2009
10.3389/neuro.11.035.2009
Front. Neuroinform.
Keywords
Field
DocType
swarm,provenance,neuroinformatics,scientific workflow,neuroimaging,data processing,batch process,bioinformatics,biomedical research
Data science,Scientific workflow system,Neuroinformatics,Data mining,Data processing,Workflow technology,Computer science,Granularity,Workflow engine,Workflow management system,Workflow
Journal
Volume
ISSN
Citations 
3
1662-5196
3
PageRank 
References 
Authors
0.51
9
7
Name
Order
Citations
PageRank
Xi Cheng1379.20
Ricardo Pizarro251.28
Yunxia Tong3364.59
Brad Zoltick430.51
Qian Luo530.85
Daniel R. Weinberger641948.41
Venkata S. Mattay78719.18