Name
Abstract | ||
|---|---|---|
MapReduce is a parallel programming model to process large datasets, and it was inspired by the Map and Reduce primitives from functional languages. Its first implementation was designed to run on large clusters of homogeneous machines. Though, in the last years, the model was ported to different types of environments, such as desktop grid and volunteer computing. To obtain a good performance in these environments, however, it is necessary to adapt some framework mechanisms, such as scheduling and data distribution algorithms. In this paper we present the MRSG simulator, which reproduces the MapReduce work-flow on top of the SimGrid simulation toolkit, and provides an API to implement and evaluate these new algorithms and policies for MapReduce. To evaluate the simulator, we compared its behavior against a real Hadoop MapReduce deployment. The results show an important similarity between the simulated and real executions. |
Year | DOI | Venue |
|---|---|---|
2013 | 10.1016/j.parco.2013.02.001 | Parallel Computing |
Keywords | Field | DocType |
parallel programming model,mapreduce work-flow,large datasets,mrsg simulator,mapreduce simulator,real execution,data distribution algorithm,real hadoop mapreduce deployment,reduce primitive,large cluster,simgrid simulation toolkit,simulator | Software deployment,Functional programming,Homogeneous,Scheduling (computing),Simulation,Computer science,Parallel computing,Parallel programming model,Porting,Grid,Volunteer computing | Journal |
Volume | Issue | ISSN |
39 | 4-5 | 0167-8191 |
Citations | PageRank | References |
19 | 0.87 | 11 |
Authors | ||
6 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Wagner Kolberg | 1 | 41 | 1.53 |
| Pedro De B. Marcos | 2 | 28 | 6.12 |
| Julio C. S. Anjos | 3 | 50 | 5.39 |
| Alexandre K. S. Miyazaki | 4 | 19 | 0.87 |
| Cláudio F. R. Geyer | 5 | 114 | 23.10 |
| Luciana Arantes | 6 | 220 | 37.48 |