云环境下求解大规模优化问题的协同差分进化算法  

Cooperative differential evolution in cloud computing for solving largescale optimization problems

作　　者：谭旭杰[1] 邓长寿[1] 吴志健[2] 彭虎[1] 朱鹊桥 TAN Xujie;DENG Changshou;WU Zhijian;PENG Hu;ZHU Queqiao(School of Information Science and Technology, Jiujiang University, Jiujiang 332005, China;State Key Laboratory of Software Engineering, Wuhan University, Wuhan 430072, China;People's Liberation Army of China 93704)

机构地区：[1]九江学院信息科学与技术学院 [2]武汉大学软件工程国家重点实验室 [3]中国人民解放军93704部队

出　　处：《智能系统学报》2018年第2期243-253,共11页CAAI Transactions on Intelligent Systems

基　　金：国家自然科学基金项目(61364025;61763019);武汉大学软件工程国家重点实验室开放基金项目(SKLSE2012-09-39);九江学院科研项目(2013KJ30;2014KJYB032);江西省教育厅科技项目(GJJ161076;GJJ161072)

摘　　要：差分进化是一种求解连续优化问题的高效算法。然而差分进化算法求解大规模优化问题时,随着问题维数的增加,算法的性能下降,且搜索时间呈指数上升。针对此问题,本文提出了一种新的基于Spark的合作协同差分进化算法(SparkDECC)。SparkDECC采用分治策略,首先通过随机分组方法将高维优化问题分解成多个低维子问题,然后利用Spark的弹性分布式数据模型,对每个子问题并行求解,最后利用协同机制得到高维问题的完整解。通过在13个高维测试函数上进行的对比实验和分析,实验结果表明算法加速明显且可扩展性好,验证了SparkDECC的有效性和适用性。Differential evolution is an efficient algorithm for solving continuous optimization problems.However,its performance deteriorates quickly and the runtime grows exponentially when differential evolution is applied to solve large-scale optimization problems.To overcome this problem,a novel cooperative coevolution differential evolution based on Spark(called SparkDECC)was proposed.The strategy of separate processing is used in SparkDECC.Firstly,the large-scale problem is decomposed into several low-dimensional sub-problems by using the random grouping strategy;then each sub-problem can be tackled in a parallel way by taking advantage of the parallel computation capability of the resilient distributed datasets model in Spark;finally the optimal solution of the entire problem is obtained by using cooperation mechanism.The experimental results on13high-dimensional functions show that the new algorithm has good performances of speedup and scalability.The effectiveness and applicability of the proposed algorithm were verified.

关 键 词：差分进化 大规模优化 协同进化 弹性分布式数据集 云计算 

分 类 号：TP301[自动化与计算机技术—计算机系统结构]