Title
Variable-Grain And Dynamic Work Generation For Minimal Unique Itemset Mining
Abstract
SUDA2 is a recursive search algorithm for Minimal Unique Itemset detection. Such sets of items are formed via combinations of non-obvious attributes enabling individual record identification. The nature of SUDA2 allows work to be divided into non-overlapping tasks enabling parallel execution. Earlier work developed a parallel implementation for SUDA2 on an SMP cluster, and this was found to be several orders of magnitude faster than sequential SUDA2. However, if fixed-granularity parallel tasks are scheduled naively in the order of their generation, the system load tends to be imbalanced with little work at the beginning and end of the search.This paper investigates the effectiveness of variable-grained and dynamic work generation strategies for parallel SUDA2. These methods restrict the number of sub-tasks to be generated, based on the criterion of probable work size. The further we descend in the search recursion tree, the smaller the tasks become, thus we only select the largest tasks at each level of recursion as being suitable for scheduling. The revised algorithm runs approximately twice as fast as the existing parallel SUDA2 for finer levels of granularity when variable-grained work generation is applied. The dynamic method, performing level-wise task selection based on size, outperforms the other techniques investigated.
Year
DOI
Venue
2008
10.1109/CLUSTR.2008.4663753
2008 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING
Keywords
Field
DocType
gain,parallel processing,computer science,correlation,data mining,electronic,scheduling
Search algorithm,Load modeling,Computer science,Scheduling (computing),Parallel computing,Real-time computing,Smp cluster,Granularity,Dynamic method,Recursion,restrict,Distributed computing
Conference
ISSN
Citations 
PageRank 
1552-5244
2
0.47
References 
Authors
6
5
Name
Order
Citations
PageRank
Paraskevas Yiapanis1515.16
David J. Haglin211219.45
Anna M. Manning3393.97
Ken Mayes4415.80
John A. Keane569592.81