高维大数据集中频繁闭合模式的挖掘  

Frequent Closet Pattern Mining in Large High Dimensional Dataset

作　　者：余光柱[1] 王亮 易先军[3] 邵世煌[1] 

机构地区：[1]东华大学信息学院 [2]湖北省荆州市环境管理信息中心,荆州434000 [3]北京大学计算机软件与微电子学院,北京102600

出　　处：《计算机工程》2008年第17期47-49,共3页Computer Engineering

基　　金：高等学校博士学科点专项科研基金资助项目(20060255006)

摘　　要：高维大数据集对现有的数据挖掘算法提出了挑战。该文把挖掘任务分解为挖掘频繁长模式与短模式2个子问题,提出一种在高维大数据集中挖掘长项集的算法,即inter-transaction。该算法利用了高维数据中长事务相交迅速变短的特性,通过事务的交集运算直接得到长闭合模式,同时采用新的减枝策略,优化了事务交集运算的方法。实验表明,该方法对高维大数据集非常有效。High dimensional large data has posed great challenges to most existing algorithms for frequent patterns mining. This paper decomposes the mining task into two parts： mining short frequent kemsets and long frequent itemsets, and proposes a new algorithm, i.e., inter-transaction, to find all long frequent closet patterns in large high dimensional dataset. The new algorithm utilizes the characteristic that the intersection of long transactions is usually a very short itemset, and can find long closet patterns directly via intersecting relevant transactions. In addition, the algorithm adopts a new pruning strategy to cut down search space and optimizes the performance of intersection of transactions. Experiments on synthetic data show that this method achieves high performance in large high dimensional dataset.

关 键 词：高维大数据集 频繁闭合模式 减枝策略 

分 类 号：TP311[自动化与计算机技术—计算机软件与理论]