Title
An efficient incremental mining algorithm-QSD
Abstract
The generation of frequent itemsets is an essential and time-consuming step in mining association rules. Most of the studies adopt the Apriori-based approach, which has great effort in generating candidate itemsets and needs multiple database accesses. Recent studies indicate that FP-tree approach has been utilized to avoid the generation of candidate itemsets and scan transaction database only twice, but they work with more complicated data structure. Besides, it needs to adjust the structure of FP-tree when it applied to incremental mining application. It is necessary to adjust the position of an item upward or downward in the structure of FP-tree when a new transaction increases or decreases the accumulation of the item. The process of the adjustment of the structure of FP-tree is the bottlenecks of the FP-tree in incremental mining application. Therefore, algorithms for efficient mining of frequent patterns are in urgent demand. This paper aims to improve both time and space efficiency in mining frequent itemsets and incremental mining application. We propose a novel QSD (Quick Simple Decomposition) algorithm using simple decompose principle which derived from minimal heap tree, we can discover the frequent itemsets quickly under one database scan. Meanwhile, QSD algorithm doesn't need to scan database and reconstruct data structure again when database is updated or minimum support is varied. It can be applied to on-line incremental mining applications without any modification. Comprehensive experiments have been conducted to assess the performance of the proposed algorithm. The experimental results show that the QSD algorithm outperforms previous algorithms.
Year
DOI
Venue
2007
10.3233/IDA-2007-11304
Intell. Data Anal.
Keywords
Field
DocType
candidate itemsets,frequent itemsets,efficient mining,on-line incremental mining application,complicated data structure,mining association rule,incremental mining application,fp-tree approach,efficient incremental mining algorithm-qsd,data structure,qsd algorithm,association rule,data mining
Data structure,Data mining,Computer science,GSP Algorithm,A priori and a posteriori,Association rule learning,Binary heap,Artificial intelligence,Database transaction,Data mining algorithm,Machine learning
Journal
Volume
Issue
ISSN
11
3
1088-467X
Citations 
PageRank 
References 
9
0.53
11
Authors
3
Name
Order
Citations
PageRank
Jen-Peng Huang1576.45
Show-Ju Chen290.53
Huang-Cheng Kuo34223.87