Title
Index-BitTableFI: An improved algorithm for mining frequent itemsets
Abstract
Efficient algorithms for mining frequent itemsets are crucial for mining association rules as well as for many other data mining tasks. Methods for mining frequent itemsets have been implemented using a BitTable structure. BitTableFI is such a recently proposed efficient BitTable-based algorithm, which exploits BitTable both horizontally and vertically. Although making use of efficient bit wise operations, BitTableFI still may suffer from the high cost of candidate generation and test. To address this problem, a new algorithm Index-BitTableFI is proposed. Index-BitTableFI also uses BitTable horizontally and vertically. To make use of BitTable horizontally, index array and the corresponding computing method are proposed. By computing the subsume index, those itemsets that co-occurrence with representative item can be identified quickly by using breadth-first search at one time. Then, for the resulting itemsets generated through the index array, depth-first search strategy is used to generate all other frequent itemsets. Thus, the hybrid search is implemented, and the search space is reduced greatly. The advantages of the proposed methods are as follows. On the one hand, the redundant operations on intersection of tidsets and frequency-checking can be avoided greatly; On the other hand, it is proved that frequent itemsets, including representative item and having the same supports as representative item, can be identified directly by connecting the representative item with all the combinations of items in its subsume index. Thus, the cost for processing this kind of itemsets is lowered, and the efficiency is improved. Experimental results show that the proposed algorithm is efficient especially for dense datasets.
Year
DOI
Venue
2008
10.1016/j.knosys.2008.03.011
Knowl.-Based Syst.
Keywords
Field
DocType
data mining,subsume index,data mining task,breadth-first search,frequent itemset,proposed algorithm,bittable structure,depth-first search strategy,index array,frequent itemsets,improved algorithm,association rule,bittable,representative item,breadth first search,depth first search,indexation,search space
Data mining,Bitwise operation,Computer science,Algorithm,Exploit,Association rule learning
Journal
Volume
Issue
ISSN
21
6
Knowledge-Based Systems
Citations 
PageRank 
References 
64
1.80
25
Authors
3
Name
Order
Citations
PageRank
Wei Song125644.41
Bingru Yang218626.67
Zhangyan Xu39710.84