Broad learning system based on the quantized minimum error entropy criterion  

作　　者：Simin ZHANG Zhulin LIU C.L.Philip CHEN 

机构地区：[1]School of Computer Science and Engineering,South China University of Technology,Guangzhou 510641,China [2]Pazhou Lab,Guangzhou 510335,China

出　　处：《Science China(Information Sciences)》2022年第12期200-215,共16页中国科学（信息科学）（英文版）

基　　金：supported by National Key Research and Development Program of China(Grant No. 2019YFB1703600);National Natural Science Foundation of China(Grant Nos. 62006079, 61751202, U1813203, U1801262);China Postdoctoral Science Foundation(Grant No. 2020TQ0105);Science and Technology Major Project of Guangzhou(Grant No. 202007030006);Natural Science Foundation of Guangdong Province(Grant No. 2021A1515011998);Program for Guangdong Introducing Innovative and Enterpreneurial Teams(Grant No. 2019ZT08X214);Science and Technology Project of Guangzhou(Grant No. 202102020634)。

摘　　要：The broad learning system(BLS) based on the minimum mean square error(MMSE) criterion can achieve outstanding performance without spending too much time in various machine learning tasks.However, when data are polluted by non-Gaussian noise, the stability of BLS may be destroyed because the MMSE criterion is sensitive to outliers. Different from the MMSE criterion, the minimum error entropy(MEE) criterion utilizes the kernel function to capture high-dimensional information and decrease the negative influence of outliers, which will make BLS more discriminative and robust. Nevertheless, the computational complexity of MEE is high due to a double summation of the data size. To solve these issues, this paper proposes a new robust BLS variant based on the quantized minimum error entropy(QMEE) criterion, in which a quantization operation is used to reduce the computational complexity of MEE. The proposed model BLS-QMEE is optimized by the fixed-point iterative method, and a sufficient condition for its convergence is provided. Compared with the standard BLS and other existing robust variants of BLS, BLS-QMEE performs more satisfactorily without consuming too much time. The desirable performance of BLS-QMEE is verified by various experiments on function approximation, several public datasets, and a practical application.

关 键 词：broad learning system quantized minimum error entropy ROBUSTNESS minimum error entropy CONVERGENCE 

分 类 号：TP18[自动化与计算机技术—控制理论与控制工程]