融合SLDA主题模型的不均衡文本分类方法  

Imbalanced Text Categorization Method with SLDA Topic Model

作　　者：唐焕玲[1,2,3] 刘艳红 郑涵 窦全胜 鲁明羽[4] TANG Huanling;LIU Yanhong;ZHENG Han;DOU Quansheng;LU Mingyu(School of Computer Science and Technology,Shandong Technology and Business University,Yantai,Shandong 264005,China;Co-innovation Center of Shandong Colleges and Universities,Yantai,Shandong 264005,China;Key Laboratory of Intelligent Information Processing in Universities of Shandong(Shandong Technology and Business University),Yantai,Shandong 264005,China;Information Science and Technology College,Dalian Maritime University,Dalian,Liaoning 116026,China)

机构地区：[1]山东工商学院计算机科学与技术学院,山东烟台264005 [2]山东省高等学校协同创新中心,山东烟台264005 [3]山东省高校智能信息处理重点实验室(山东工商学院),山东烟台264005 [4]大连海事大学信息科学技术学院,辽宁大连116026

出　　处：《计算机工程与应用》2021年第12期144-154,共11页Computer Engineering and Applications

基　　金：国家自然科学基金(61976124,61976125,61772319,61773244,61972235)。

摘　　要：在标签均衡分布且标注样本足够多的数据集上,监督式分类算法通常可以取得比较好的分类效果。然而,在实际应用中样本的标签分布通常是不均衡的,分类算法的分类性能就变得比较差。为此,结合SLDA(Supervised LDA)有监督主题模型,提出一种不均衡文本分类新算法ITC-SLDA(Imbalanced Text Categorization based on Supervised LDA)。基于SLDA主题模型,建立主题与稀少类别之间的精确映射,以提高少数类的分类精度。利用SLDA模型对未标注样本进行标注,提出一种新的未标注样本的置信度计算方法,以及类别约束的采样策略,旨在有效采样未标注样本,最终降低不均衡文本的倾斜度,提升不均衡文本的分类性能。实验结果表明,所提方法能明显提高不均衡文本分类任务中的Macro-F1和G-mean值。Supervised categorization algorithms can yield better categorization performance in datasets with enough and balanced labels.However,various real-world categorization tasks suffer from the class imbalance problem which has been known to hinder the learning performance of categorization algorithms.This paper,demonstrates that SLDA model is capable of solving the class imbalance problem by sampling unlabeled instances.In order to yield a better prediction per-formance with minority classes,the semantic relationship between topics and minority classes is derived by the SLDA topic model.An efficient way of calculating confidence and sampling valuable unlabeled instances is proposed.The proposed method reduces the skewness of the imbalanced datasets efficiently and improves the categorization performance of minority classes.Our experimental results show that the the proposed method,ITC-SLDA algorithm,can significantly improve Macro-F1 and G-mean values in imbalanced text categorization.

关 键 词：有监督主题模型 半监督学习 不均衡文本 分类 

分 类 号：TP181[自动化与计算机技术—控制理论与控制工程]