基于Spark框架的网络大数据分类处理方法研究  

Research on Classification Processing Method of Network Big Data Based on Spark Framework

作　　者：王志 WANG Zhi(Zhengzhou University of Industrial Technology,Zhengzhou Henan 451100,China)

机构地区：[1]郑州工业应用技术学院,河南郑州451100

出　　处：《信息与电脑》2021年第10期49-51,共3页Information & Computer

摘　　要：传统分类方法对于动态数据处理能力较差,无法得到高精度分类结果.针对此情况,设计基于Spark框架的网络大数据分类处理方法.通过构建网络大数据分类处理平台与网络数据分类器,完成网络大数据分类处理过程.经实验结果证实,Spark框架分类方法使用效果较好,能够实现高精度数据处理.The current classification methods have poor processing ability for dynamic data,and cannot get high-precision classification results.In view of this situation,a classification processing method of network big data based on Spark framework is designed.Through the construction of network big data classification processing platform,network data classifier and network data classification processing,the network big data classification processing process is completed.Experimental results show that Spark framework classification method is effective and can achieve high-precision data processing.

关 键 词：Spark框架 数据聚类分析 BOOSTING算法 机器学习算法 

分 类 号：TP311[自动化与计算机技术—计算机软件与理论]