一种客户端短信过滤的样本特征库生成方法  

A Sample Characteristics Library Generation Method of Client SMS Filtering

作　　者：包理群[1] 侯志伟[2] 李祥林[1] 

机构地区：[1]兰州工业学院电子信息工程系,兰州730050 [2]兰州交通大学电子信息工程学院,兰州730070

出　　处：《计算机工程》2014年第1期199-202,共4页Computer Engineering

基　　金：甘肃省自然科学基金资助项目(1208RJZA186);甘肃省高等学校科研基金资助项目(2013A-127);甘肃省科技支撑计划基金资助项目(1104GKCA032);兰州市科技计划基金资助项目(2010-1-225)

摘　　要：针对目前中文短信过滤研究缺乏样本库的现状,提出一种客户端样本特征库生成方法。设计客户端短信过滤样本特征数据库,将客户端接收到的短信进行预处理和中文分词,考虑高信息量的低频词和带有较强类别特性的特征词,改进互信息评价函数提取样本特征,形成特征数据。采用Naive Bayes算法测试特征数目对过滤器性能的影响,实验结果表明,当特征数目为10时,测试准确率达到最大值,当样本特征库中短信数目达到2 000条时,数据库文件的大小约为714.28 KB,可在普通手机平台上运行,验证了特征库生成方法的可行性。In view of the lack of Chinese SMS sample libraries, this paper proposes a client sample characteristics library generation method. It gives the design of sample characteristics database for client SMS spam filtering, and completes text preprocessing and Chinese word segmentation for messages received from the client, considering the low frequency words having a high amount of information and terms with strong category characteristic, it improves mutual information extraction evaluation function, and extracts the sample characteristic and forms the characteristic data. Experiment tests the impact of the number of features on filter performance using the Bayesian algorithm, and results show that the accuracy rate reaches a maximum when the number of features is 10. Experiment also tests the database file size, and when the number of key words reach 2 000, the size of database file is about 714.28 KB. It can run on the ordinary mobile phone platform, and tests show the feasibility of the method.

关 键 词：客户端短信过滤 样本特征库 嵌入式数据库 ARM—Linux平台 移植 互信息 

分 类 号：TP18[自动化与计算机技术—控制理论与控制工程]