基于自组合核的增量分类方法  

Incremental classification based on self-compounding kernel

作　　者：冯林[1,2] 张晶[1,2] 吴振宇[2] 

机构地区：[1]大连理工大学电子信息与电气工程学部计算机科学与技术学院,辽宁大连116024 [2]大连理工大学创新创业学院,辽宁大连116024

出　　处：《系统工程与电子技术》2016年第8期1958-1968,共11页Systems Engineering and Electronics

基　　金：国家自然科学基金(61173163;61370200)资助课题

摘　　要：在线极端学习机(online sequential extreme learning machine,OSELM)模型在解决动态数据实时分类问题时,无需批量计算,仅保留前一时刻训练模型,根据当前时刻样本调整原有模型即可。然而,该增量方法在离线训练阶段随机指定隐层神经元使模型鲁棒性差,且求解过程难以拓展于核方法,降低了分类效果。针对上述问题,提出一种基于自组合核的在线极端学习机(self-compounding kernel online sequential extreme learning machine,SCK-OSELM)模型。首先,提出一种新的自组合核(self-compounding kernel,SCK)方法,构建样本不同核空间的非线性特征组合,该方法可被应用于其他监督核方法中。其次,以稀疏贝叶斯为理论基础将训练数据的先验分布作为模型权值引入,并利用超参调整权值后验分布,从而达到对当前时间点参数稀疏的目的。最后,将稀疏得到的参数并入下一时刻运算。对动态数据的实时分类实验表明,该方法是一种有效的增量学习算法。相比于OSELM,该方法在解决动态数据实时分类问题时获得更稳定、准确的分类效果。Online sequential kernel extreme learning machine（OSELM）is an increment classification algorithm,and it only keeps training model at last time,then adjusts the original model from the current samples.However,it does not batch calculation when solving the problem of real-time dynamic data classification.This method by minimizing the empirical risk leads to the over-fitting,and randomly assigns hidden layer neurons in offline training,which makes the model have poor robust.Moreover,the solving process is difficult to be extended to the kernel method,which reduces the classification accuracy.Pointing to above-mentioned problems,a new online classification method,self-compounding kernels OSELM（SCK-OSELM）,is proposed based on the kernel method.Firstly,inputted samples are mapped to multi-kernel spaces to obtain different features,and the nonlinear combination of features are calculated.Proposed self-compounding kernels method is used to others supervised kernel methods.Secondly,the prior distribution of training samples as model weights are introduced to maintain the model generalization,and by using the super weight to make the posterior distribution of weights to zero,thus sparse parameter is achieved.Finally,the parameter of sparse are incorporated into the next moment common operations.Numerical experiments indicate that the proposed method is effective.In comparison with OSELM,the proposed method has better performance in the sense of stability and classification accuracy,and is suitable for real-time dynamic data classification.

关 键 词：动态数据 在线极端学习机 自组合核 稀疏贝叶斯 

分 类 号：TP319[自动化与计算机技术—计算机软件与理论]