结合L1和L2正则化约束的隐语义预测模型研究  

Latent Factor Prediction Model Combining L1 and L2 Regularization Constraints

作　　者：王德贤[1] 何先波[1] 贺春林[1] 周坤[1] 陈敏治 WANG Dexian;HE Xianbo;HE Chunlin;ZHOU Kun;CHEN Minzhi(School of Computer Science,China West Normal University,Nanchong,Sichuan 637000 China)

机构地区：[1]西华师范大学计算机学院

出　　处：《计算机工程与应用》2019年第19期121-127,共7页Computer Engineering and Applications

基　　金：国家大学生创新创业专项基金(No.201510638047);四川省教育厅重点项目(No.15ZA048,No.13ZA0015);南充市科技支撑项目(No.15A0068);西华师范大学英才基金(No.17YC150)

摘　　要：在大数据领域中预测高维稀疏矩阵中的缺失数据,通常采用随机梯度下降算法构造隐语义模型来对缺失数据进行预测。在随机梯度下降算法来求解模型的过程中经常加入正则化项来提高模型的性能,由于L1正则化项不可导,目前在隐语义模型中主要通过加入L2正则化项来构建隐语义模型(SGD_LF)。但因为L1正则化项能提高模型的稀疏性增强模型求解能力,因此提出一种基于L1和L2正则化约束的隐语义(SPGD_LF)模型。在通过构建目标函数时,同时引入L1和L2正则化项。由于目标函数满足利普希茨条件,并通过二阶的泰勒展开对目标函数进行逼近,构造出随机梯度下降的求解器,在随机梯度下降求解隐语义模型的过程中通过软阈值来处理L1正则化项所对应的边界优化问题。通过此优化方案,可以更好地表达目标矩阵中的已知数据在隐语义空间中的特征和对应的所属社区关系,提高了模型的泛化能力。通过在大型工业数据集上的实验表明,SPGD_LF模型的预测精度、稀疏性和收敛速度等性能都有显著提高。LF model is usually built by SGD method and it's used to predict the missing data of high-dimensional sparse matrix in big data field.LF model need to integrate regularization terms to improve its performance.Due to L1 regularization term is non-differentiable,normally integrates L2 regularization term into an LF model only.However,the L1 regularization normal can improve the sparsity and solving ability of LF model.To solve the issue,this paper proposes a SPGD_LF model that simultaneously integrates both L1 and L2 regularization terms in to an LF model.Since the objective function satisfies the Lipschitz condition and approximates the objective function by second-order Taylor expansion, a solver for stochastic gradient descent is constructed.In the process of stochastic gradient descent,the soft threshold process deals with the boundary optimization problem corresponding to the L1 regularization term and solves the implicit semantic model.Through this optimization scheme,the characteristics of the known data in the target matrix in the latent factor space and the corresponding community relationship can be better expressed,and the generalization ability of the model is improved.Empirical studies on two datasets from industrial applications and the results show that the prediction accuracy,sparsity and convergence rate of SPGD_LF model are improved significantly.

关 键 词：大数据应用 高维稀疏矩阵 隐语义 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]