基于关键词策略和CNN的中文文本有害信息分类  

Classification of Chinese Text Harmful Information Based on Keywords Strategy and Convolutional Neural Network

作　　者：陈德意 张宏怡 刘彩玲 张光斌[2] CHEN Deyi;ZHANG Hongyi;LIU Cailing;ZHANG Guangbin(College of Optoelectronics and Communication Engineering,Xiamen University of Technology,Xiamen 361024,China;Xiamen Meiya Pico Information Co.,Ltd.,Xiamen 361005,China)

机构地区：[1]厦门理工学院光电与通信工程学院,福建厦门361024 [2]厦门市美亚柏科信息股份有限公司,福建厦门361005

出　　处：《集美大学学报（自然科学版）》2020年第5期392-400,共9页Journal of Jimei University：Natural Science

摘　　要：提出一种新颖的中文文本分类框架。在该框架中,首先基于Word2Vec构建词向量模型,然后采用分词频文档频率(segmentation term frequency-document frequency,STF-DF)筛选出类别区分能力强的关键词,同时构建一种适合于中文文本分类的卷积神经网络(convolution neural network,CNN)进行分类。实验结果表明,采用该框架使THUCNews和复旦大学中文文本数据集中的准确率分别达到了94.51%和95.04%,同时在真实的有害信息数据集中取得了99.70%的召回率,这验证了所提出框架的有效性和实用价值。The rapid development of internet and big data technology has greatly facilitated people s access to various Chinese text information,but also greatly increased the risk of dissemination of harmful information in Chinese text.The traditional text processing method based on vector representation is mainly used to process English text.To deal with these problems,a novel Chinese text classification framework was proposed.In this framework,a word vector model based on Word2Vec was constructed firstly.Then the keywords with distinguishing category ability were selected by using word document frequency(segmentation term frequency-document frequency,STF-DF).Meanwhile,a suitable convolution neural network(CNN)was build for Chinese text classification.The experimental results show that the accuracy of this framework in THUCNews and Fudan University Chinese text data set is 94.51%and 95.04%respectively,and the recall rate is 99.70%in the real harmful information data set,which verifies the effectiveness and good practical value of the proposed framework.

关 键 词：词向量 分词频文档频率 特征词集合 Word2Vec模型 卷积神经网络 

分 类 号：TP312[自动化与计算机技术—计算机软件与理论]