改进向量投影的支持向量预选取方法  

Support Vectors Pre-Extracting Method Based on Improved Vector Projection

作　　者：杨静[1] 于旭 谢志强[1,2] 

机构地区：[1]哈尔滨工程大学计算机科学与技术学院,哈尔滨150001 [2]哈尔滨理工大学计算机科学与技术学院,哈尔滨150080

出　　处：《计算机学报》2012年第5期1002-1010,共9页Chinese Journal of Computers

基　　金：国家自然科学基金(60873019;61073041;61073043);黑龙江省自然科学基金(F200901);中国博士后科学基金(20090460880);黑龙江省博士后科学基金(LBH-Z09214);哈尔滨市优秀学科带头人研究专项资金(2011RFXXG015)资助~~

摘　　要：针对基于向量投影的支持向量预选取方法选取投影直线过于简单粗糙,导致需要选取较多的边界向量才能包含原始问题的支持向量的问题,提出了一种新的支持向量预选取方法.该方法通过定义好的投影直线具备的3个必要特征,提出:对于线性可分情况,利用Fisher线性判别算法来获取最佳的投影直线;对于非线性可分情况,利用特征空间中心向量所在直线作为相应的投影直线.由于该方法确定的投影直线可以更好地对样本投影进行分离,因此,与基于向量投影的支持向量预选取方法相比,该方法可用更少的原始样本来构造边界向量集合,可有效降低支持向量机算法的时空复杂度.在两个人工数据集和一个现实数据集上的实验表明,所提方法不仅可以达到以往各种实用的支持向量机算法分类精度,而且更为高效.For the question that the projection line of support vectors pre-extracting method based on vector projection is selected so rough that more bound vectors need to be selected to include the support vectors,a novel support vectors pre-extracting method is proposed.By defining the three necessary characteristics of a good projection line,for linear separable problems,the best projection orientation is determined by Fisher linear discriminant algorithm,and for non-linear separable problems,the orientation of the mean vector in the feature space is considered as the projection orientation.As the projection orientation determined by this method can separate the projection of the samples better,so compared with the previous support vectors pre-extracting method,the bound vectors set in this method can be composed of fewer original samples.Thus the time and space complexities of SVMs can effectively be reduced.Experiments on two artifical data sets and one real-world data set show that the proposed method can be as accurate as previous applied SVMs,but is much faster than them.

关 键 词：支持向量机 边界向量集合 FISHER线性判别 中心向量 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]