Name
Abstract | ||
|---|---|---|
Most users process short tasks using MapReduce. In other words, most tasks handled by the Map and Reduce functions require low response time. Currently, quite few users use MapReduce for 2D to 3D image processing, which is highly complicated and requires long execution time. However, in our opinion, MapReduce is exactly suitable for processing applications of high complexity and high computation. This paper implements MapReduce on an integrated 2D to 3D multi-user system, in which Map is responsible for image processing procedures of high complexity and high computation, and Reduce is responsible for integrating the intermediate data processed by Map for the final output. Different from short tasks, when several users compete simultaneously to acquire data from MapReduce for 2D to 3D applications, data that waits to be processed by Map will be delayed by the current user and Reduce has to wait until the completion of all Map tasks to generate the final result. Therefore, a novel scheduling scheme, Dynamic Switch of Reduce Function (DSRF) Algorithm, is proposed in this paper for MapReduce to switch dynamically to the next task according to the achieved percentage of tasks and reduce the idle time of Reduce. By using Hadoop to implement our MapReduce platform, we compare the performance of traditional Hadoop with our proposed scheme. The experimental results reveal that our proposed scheduling scheme efficiently enhances MapReduce performance in running 2D to 3D applications. |
Year | DOI | Venue |
|---|---|---|
2012 | 10.1016/j.comcom.2012.06.015 | Computer Communications |
Keywords | Field | DocType |
cloud-based image processing system,reduce function,map task,short task,priority-based data distribution mechanism,image processing,high computation,high complexity,image processing procedure,idle time,mapreduce platform,mapreduce performance,3d image | Scheduling (computing),Computer science,2D to 3D conversion,Image processing,Computer network,Response time,Real-time computing,Execution time,Computation,Idle time,Distributed computing,Cloud computing | Journal |
Volume | Issue | ISSN |
35 | 15 | 0140-3664 |
Citations | PageRank | References |
9 | 0.65 | 12 |
Authors | ||
5 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Tin-Yu Wu | 1 | 171 | 23.21 |
| Chi-Yuan Chen | 2 | 140 | 19.76 |
| Ling-Shang Kuo | 3 | 9 | 0.65 |
| Wei-Tsong Lee | 4 | 171 | 30.59 |
| Han-Chieh Chao | 5 | 2502 | 214.00 |