Title
Dynamic Provisioning of Data Intensive Computing Middleware Frameworks: A Case Study
Abstract
Big data has become an important asset for industry, and academic disciplines now utilize large-scale data in their research. This fourth paradigm of scientific research has led to the inclusion of data management, processing, and analytic tools into the traditional high performance computing software libraries. This integration is facilitated through a collection of supporting software components that comprise a data intensive computing middleware framework. From a shared campus cyberinfrastructure perspective, this represents a new challenge to the system administrators in balancing between the traditional high performance computing software stacks and the new data-intensive middleware on the same physical computing resource. In turn, this limits researchers from having access to the new middleware tools while administrators determine how to overcome the challenge. In this paper, we present our experience in configuring dynamic provisioning of two different data-intensive middleware frameworks from a user perspective. We describe the configuration process from setting up dependencies to deploying the middleware, and how this experience can be applied by other researchers and administrators.
Year
DOI
Venue
2015
10.1145/2753524.2753528
SCREAM@HPDC
Field
DocType
Citations 
Middleware,Middleware (distributed applications),World Wide Web,Data-intensive computing,Software engineering,Computer science,Provisioning,Cyberinfrastructure,Component-based software engineering,Data management,Message oriented middleware
Conference
1
PageRank 
References 
Authors
0.37
19
5
Name
Order
Citations
PageRank
Linh Bao Ngo1285.94
Michael E. Payne240.76
Flavio Villanustre32038.85
Richard N. Taylor45395482.75
Amy W. Apon510418.27