基于特征项分布的信息熵及特征动态加权概念漂移检测模型  

Construction of the Concept Drift Detection Model Based on the Information Entropy of Feature Distribution and Dynamic Weighting Algorithm

作　　者：孙雪[1] 李昆仑[2] 韩蕾[1] 白晓亮[1] 

机构地区：[1]河北大学工商学院,河北保定071002 [2]河北大学电子信息工程学院,河北保定071000

出　　处：《电子学报》2015年第7期1356-1361,共6页Acta Electronica Sinica

基　　金：国家自然基金(No.61073121);河北省自然基金(No.F2013201170);国家科技支撑计划(No.2013BAK07B04);河北省高等学校科学技术研究重点项目(No.ZD2014008);河北大学青年基金(No.2010Q17)

摘　　要：现有的概念漂移算法大多建立在数据流的分类模型上,忽略了特征空间与样本空间的分布特点,以及特征选择和加权的重要性.针对此问题提出了一种基于特征项分布的信息熵及特征动态加权算法,从概念漂移的动态演化性出发,根据样本和特征空间的拟合程度,运用特征信息熵理论对数据流中的概念漂移现象进行捕捉,以实现新旧概念的过渡.利用改进的隐含Dirichlet模型特征动态加权算法,以解决当前特征与历史特征的权重确定和无效特征的裁剪问题.在公开的语料库CCERT和Trec06上的测试实验证明了所提出算法的有效性.Most of the existing concept drift algorithm focuses on the classification model data streams,some of which overlook the distribution of the feature space and sample space,and the importance of feature selection and weighting.To solve this problem,we propose a dynamic information entropy and feature weighting algorithm based on the distribution of feature items from the dynamic evolution of the concept drift departure. To realize the concept transition,we capture the concept drifting of the data stream by the information entropy,according to the fitness degree between the sample and feature space. We improve the feature dynamic weighting latent dirichlet model,to overcome the problem of the current and historical feature weight assignment,as well as cropping the invalid features. Furthermore,the validity of the proposed algorithm was confirmed by the test in open corpus CCERT and Trec06.

关 键 词：概念漂移 LDA模型 特征项分布 信息熵 

分 类 号：TP391.4[自动化与计算机技术—计算机应用技术] TP181[自动化与计算机技术—计算机科学与技术]