多注意力机制融合低高阶特征的神经推荐算法  

Neural Recommendation Algorithm Using Combinations of Low and High-Order Features Based on Multi-Attention Mechanism

作　　者：崔少国 独潇 杨泽田 CUI Shaoguo;DU Xiao;YANG Zetian(School of Computer and Information Sciences,Chongqing Normal University,Chongqing 401331,China)

机构地区：[1]重庆师范大学计算机与信息科学学院,重庆401331

出　　处：《计算机工程与应用》2023年第8期192-199,共8页Computer Engineering and Applications

基　　金：国家自然科学基金(62003065);重庆师范大学基金(20XLB004);重庆市科技局项目(cstc2019jscx-mbdxX0061);教育部人文社科项目(18XJC880002);重庆市教委科技项目(KJQN201800539,KJQN202000510)。

摘　　要：针对因子分解机仅提取低阶组合特征的局限性,提出了一种基于多注意力机制融合低阶和高阶组合特征的深度神经推荐算法(deep neural recommendation method,DeepNRM)。分别运用因子分解机和多层前馈神经网络从稀疏及稠密特征中提取低阶和高阶组合特征;采用注意力网络和多头自注意力机制从低阶和高阶组合特征中自动选取关键特征;将低、高阶组合特征根据重要性进行融合共同进行推荐。算法模型在MovieLens和Criteo公共数据集上进行了实验验证,消融和对比实验结果表明,提出的算法模型与基准模型相比在AUC指标上分别有1.964个百分点和0.773个百分点的提升。Aimed at the limitations of factorization machine in extracting only low-order combinatorial features,a deep neural recommendation method based on multi-attention mechanism(DeepNRM)is proposed based on multi-attention mechanism.Firstly,the factorization machine and multi-layer feed-forward neural network are used to extract low-order and high-order combined features from sparse and dense features respectively.Then it uses the attention network and the multi-head self-attention mechanism to automatically select key features from the combination of low-order and highorder features.Finally,it mixes low-order and high-order combined features based on their importance to produce recommendations.The algorithm model is experimentally validated on the common datasets of MovieLens and Criteo,and the ablation and comparative experimental results show that compared with the baseline model,there are 1.964 percentage points and 0.773 percentage points AUC improvements on the two datasets,respectively.

关 键 词：因子分解机 推荐系统 深度神经网络 多头自注意力机制 特征抽取 

分 类 号：TP391.1[自动化与计算机技术—计算机应用技术]