Effective and Efficient Feature Selection for Large-scale Data Using Bayes' Theorem  

作　　者：Subramanian Appavu Alias Balamurugan Ramasamy Rajaram 

机构地区：[1]Department of Information Technology, Thiagarajar College of Engineering [2]Department of Computer Science and Information Technology, Thiagarajar College of Engineering

出　　处：《International Journal of Automation and computing》2009年第1期62-71,共10页国际自动化与计算杂志（英文版）

摘　　要：This paper proposes one method of feature selection by using Bayes＇ theorem. The purpose of the proposed method is to reduce the computational complexity and increase the classification accuracy of the selected feature subsets. The dependence between two attributes （binary） is determined based on the probabilities of their joint values that contribute to positive and negative classification decisions. If opposing sets of attribute values do not lead to opposing classification decisions （zero probability）, then the two attributes are considered independent of each other, otherwise dependent, and one of them can be removed and thus the number of attributes is reduced. The process must be repeated on all combinations of attributes. The paper also evaluates the approach by comparing it with existing feature selection algorithms over 8 datasets from University of California, Irvine （UCI） machine learning databases. The proposed method shows better results in terms of number of selected features, classification accuracy, and running time than most existing algorithms.This paper proposes one method of feature selection by using Bayes＇ theorem. The purpose of the proposed method is to reduce the computational complexity and increase the classification accuracy of the selected feature subsets. The dependence between two attributes （binary） is determined based on the probabilities of their joint values that contribute to positive and negative classification decisions. If opposing sets of attribute values do not lead to opposing classification decisions （zero probability）, then the two attributes are considered independent of each other, otherwise dependent, and one of them can be removed and thus the number of attributes is reduced. The process must be repeated on all combinations of attributes. The paper also evaluates the approach by comparing it with existing feature selection algorithms over 8 datasets from University of California, Irvine （UCI） machine learning databases. The proposed method shows better results in terms of number of selected features, classification accuracy, and running time than most existing algorithms.

关 键 词：Data mining CLASSIFICATION feature selection dimensionality reduction Bayes＇ theorem. 

分 类 号：TP311.13[自动化与计算机技术—计算机软件与理论]