一种基于MapReduce的并行PSO-BP神经网络算法  

Parallel PSO-BP Neural Network Algorithm Based on MapReduce

作　　者：崔红艳[1] 曹建芳[1] 史昊[2] Cui Hongyan;Cao Jianfang;Shi Hao(Department of Computer Science and Technology,Xinzhou Teachers University,XinzhouShanxi 034000,China;School of Computer Science and Technology,Taiyuan University of Science and Technology,Taiyuan 030024,China)

机构地区：[1]忻州师范学院计算机科学与技术系,山西忻州034000 [2]太原科技大学计算机科学与技术学院,太原030024

出　　处：《科技通报》2017年第4期110-115,共6页Bulletin of Science and Technology

基　　金：2014年度山西省大学生创新创业训练项目(2014383);2013年度国家自然基金项目(61202163);2013年度山西省自然基金项目(2013011017-2)

摘　　要：为了提高BP神经网络算法的分类准确率和运行时间效率,利用PSO算法和并行化设计的思想,提出了Hadoop平台下基于MapReduce的PSO优化BP神经网络的并行化设计及实现方法。利用PSO算法优化BP神经网络的初始权值和阈值,提高算法分类准确率;采用MapReduce并行编程模型实现算法的并行化处理,解决了BP神经网络在处理大规模样本数据集时存在的硬件开销和通信开销大的问题。选用SUN Database场景图像库构造了5个不同规模的数据集,通过与传统的串行PSO-BP神经网络算法实验对比,并行化的PSO-BP神经网络算法分类准确率达92%左右,系统效率在0.85左右,在处理大规模数据集时具有明显的优越性。To improve the time efficiency and the accuracy rate of classifying results of BP neural network,parallel PSO-BP neural network algorithm is proposed using the idea of PSO algorithm andparallelization on the Hadoop platform.PSO algorithm is used to optimize the initial weights andthresholds of BP neural network to improve the accuracy rate of classifying results;MapReduce parallelprogramming model is adopted to realize the parallel processing of the algorithm,which solves theproblem of the hardware overhead and communication overhead when BP neural network deals with largescale sample data sets.5different scale data sets are constructed by using SUN Database.Comparedwith traditional serial PSO-BP neural network algorithm,the accuracy rate of classifying results ofparallel PSO-BP neural network algorithm is about92%and the system efficiency is about0.85,whichhas obvious both in time and the classified results in processing larger data sets.

关 键 词：PSO算法 BP神经网络 MapReduce编程模型 HADOOP平台 并行化处理 大规模数据集 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]