基于MapReduce的层叠分组并行SVM算法研究  

RESEARCH ON CASCADE-GROUPING PARALLEL SVM ALGORITHM BASED ON MAPREDUCE

作　　者：张鹏翔[1] 刘利民[1] 马志强[1] 

机构地区：[1]内蒙古工业大学信息工程学院,内蒙古呼和浩特010080

出　　处：《计算机应用与软件》2015年第3期172-176,共5页Computer Applications and Software

基　　金：国家自然科学基金项目(61363052);内蒙古自然科学基金项目(2010MS0913);内蒙古自治区气象信息中心合作项目

摘　　要：随着训练集规模的不断增大,支持向量机学习成为了密集型计算的过程。针对计算过程中存在占用内存大、寻优速度慢等问题,通过大量实验对分组训练和层叠训练两种并行SVM算法进行性能分析,给出层叠分组SVM并行算法,并利用MapReduce并行框架实现,解决了层叠训练模型效率低的问题。实验结果表明,采用这种学习策略,在保持精度损失较小的情况下,一定程度上减少了训练时间,提高了分类速度。With the constant growing of training set scale,support vector machine learning becomes intensive computing process. In view of the problems in calculation process including large memory and slow optimisation,we analyse the performances of two parallel SVM algorithms of grouping training and cascade training through a great deal of experiments,and present the cascade-grouping SVM parallel algorithm,and implement it using MapReduce parallel framework,this solves the problem of low efficiency of cascade training model.Experimental results show that by using this learning strategy,the training time is reduced and the classification speed is improved both to a certain extent without big precision loss.

关 键 词：并行分类算法 支持向量机 MAPREDUCE 大规模数据集处理 

分 类 号：TP301[自动化与计算机技术—计算机系统结构]