Title
Locality Aware Task Scheduling in Parallel Data Stream Processing.
Abstract
Parallel data processing and parallel streaming systems become quite popular. They are employed in various domains such as real-time signal processing, OLAP database systems, or high performance data extraction. One of the key components of these systems is the task scheduler which plans and executes tasks spawned by the system on available CPU cores. The multiprocessor systems and CPU architecture of the day become quite complex, which makes the task scheduling a challenging problem. In this paper, we propose a novel task scheduling strategy for parallel data stream systems, that reflects many technical issues of the current hardware. We were able to achieve up to 3x speed up on a NUMA system and up to 10% speed up on an older SMP system with respect to the unoptimized version of the scheduler. The basic ideas implemented in our scheduler may be adopted for task schedulers that focus on other priorities or employ different constraints.
Year
DOI
Venue
2014
10.1007/978-3-319-10422-5_35
Studies in Computational Intelligence
Keywords
Field
DocType
Parallel,multicore CPU,NUMA,cache aware,task scheduling,data streams
Data stream mining,Fair-share scheduling,Scheduling (computing),Data stream,Computer science,Multiprocessing,Online analytical processing,Multi-core processor,Distributed computing,Speedup
Conference
Volume
ISSN
Citations 
570
1860-949X
5
PageRank 
References 
Authors
0.46
13
5
Name
Order
Citations
PageRank
Zbynek Falt1274.18
Martin Krulis27613.27
David Bednárek34310.89
Jakub Yaghob411415.74
Filip Zavoral511919.01