基于MapReduce改进离散型萤火虫算法和多重分形的属性约简方法  

Attribute Reduction Method Based on MapReduce-Based Improved Discrete Glowworm Swarm Algorithm and Multi-fractal Dimension

作　　者：陆玉佳 倪志伟[1,2] 朱旭辉[1,2] 许力分 伍章俊[1,2] LU Yujia;NI Zhiwei;ZHU Xuhui;XU Lifen;WU Zhangjun(School of Management, Hefei University of Technology, Hefei 230009;Key Laboratory of Process Optimization and Intelligent Decision-Making of Ministry of Education, Hefei University of Technology, Hefei 230009)

机构地区：[1]合肥工业大学管理学院,合肥230009 [2]合肥工业大学过程优化与智能决策教育部重点实验室,合肥230009

出　　处：《模式识别与人工智能》2018年第6期537-547,共11页Pattern Recognition and Artificial Intelligence

基　　金：国家自然科学基金重大研究计划培育项目(No.91546108);国家自然科学基金重大项目(No.91490725);国家自然科学基金创新研究群体项目(No.71521001);安徽省自然科学基金项目(No.1708085MG169);安徽省教育厅人文社会科学研究项目(No.JS2017AJRW0135)资助~~

摘　　要：针对大数据环境下属性约简问题,提出基于MapReduce改进离散型萤火虫算法(IDGSO)和多重分形(MFD)的属性约简方法.首先,通过对萤火虫个体的移动方式进行离散化改进,引入迁徙策略和高斯变异策略,避免陷入局部最优,并提出改进离散型萤火虫算法.然后,将IDGSO结合MFD应用于属性约简中.最后,针对大数据环境下属性约简问题,采用MapReduce编程模式,实现对IDGSO和MFD的并行化.在UCI数据集和实际气象数据集上的实验表明,文中算法约简性能较优,运行效率较快,具有较好的有效性和可行性.To solve the problem of attribute reduction in a big data environment, an attribute reduction method based on MapReduce-based improved discrete glowworm swarm algorithm（IDGSO） and muhi-fractal dimension （MFD） is proposed. Firstly, the moving way of glowworm individuals is discretized to avoid the algorithm falling into local optimum, and the migration strategy and Gaussian mutation strategy are introduced. An improved discrete glowworm swarm algorithm is proposed. Secondly, the improved discrete glowworm algorithm combined with multi-fractal dimension is applied to attribute reduction. Finally, to solve the problem mentioned above, the MapReduce programming model is adopted to realize the parallelization of IDGSO and MFD. Experiments on UCI datasets and the real meteorological datasets show that the proposed method produces high efficiency, effectiveness and feasibility of reduction.

关 键 词：属性约简 多重分形(MFD) 离散型萤火虫算法 MAPREDUCE 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]