Deep LearningModel for Big Data Classification in Apache Spark Environment  

作　　者：T.M.Nithya R.Umanesan T.Kalavathidevi C.Selvarathi A.Kavitha 

机构地区：[1]Department of Computer Science and Engineering,K.Ramakrishnan College of Engineering,Trichy,Tamilnadu,620009,India [2]Department of Information and Communication Engineering,Anna University,Chennai,Tamilnadu,600025,India [3]Department of Electronics and Instrumentation Engineering,Kongu Engineering College,Erode,Tamilnadu,638060,India [4]Department of Computer Science and Engineering,M.Kumarasamy College of Engineering,Karur,Tamilnadu,639113,India [5]Department of Electronics and Communication Engineering,K.Ramakrishnan College of Engineering,Trichy,Tamilnadu,620009,India

出　　处：《Intelligent Automation & Soft Computing》2023年第9期2537-2547,共11页智能自动化与软计算（英文）

摘　　要：Big data analytics is a popular research topic due to its applicability in various real time applications.The recent advent of machine learning and deep learning models can be applied to analyze big data with better performance.Since big data involves numerous features and necessitates high computational time,feature selection methodologies using metaheuristic optimization algorithms can be adopted to choose optimum set of features and thereby improves the overall classification performance.This study proposes a new sigmoid butterfly optimization method with an optimum gated recurrent unit(SBOA-OGRU)model for big data classification in Apache Spark.The SBOA-OGRU technique involves the design of SBOA based feature selection technique to choose an optimum subset of features.In addition,OGRU based classification model is employed to classify the big data into appropriate classes.Besides,the hyperparameter tuning of the GRU model takes place using Adam optimizer.Furthermore,the Apache Spark platform is applied for processing big data in an effective way.In order to ensure the betterment of the SBOA-OGRU technique,a wide range of experiments were performed and the experimental results highlighted the supremacy of the SBOA-OGRU technique.

关 键 词：Big data apache spark classification feature selection gated recurrent unit adam optimizer 

分 类 号：TP311.13[自动化与计算机技术—计算机软件与理论]