检索规则说明:AND代表“并且”;OR代表“或者”;NOT代表“不包含”;(注意必须大写,运算符两边需空一格)
检 索 范 例 :范例一: (K=图书馆学 OR K=情报学) AND A=范并思 范例二:J=计算机应用与软件 AND (U=C++ OR U=Basic) NOT M=Visual
作 者:张强[1] 彭骨 薛陈斌 ZHANG Qiang;PENG Gu;XUE Chenbin(School of Computer and Information Technology,Northeast Petroleum University,Daqing 163318,Heilongjiang Province,China)
机构地区:[1]东北石油大学计算机与信息技术学院,黑龙江大庆163318
出 处:《吉林大学学报(理学版)》2024年第4期933-942,共10页Journal of Jilin University:Science Edition
基 金:国家自然科学基金(批准号:42002138);黑龙江省自然科学基金(批准号:LH2022F008);黑龙江省博士后专项基金(批准号:LBH-Q20077);黑龙江省优秀青年教师基础研究支持计划项目(批准号:YQJH2023073)。
摘 要:针对图注意力网络处理噪声和时序数据较弱,并且在堆叠多层后出现梯度爆炸、过平滑等问题,提出一种改进图注意力网络模型.首先,使用Squeeze-and-Excitation模块对样本输入数据的特征信息进行不同程度关注,增强模型处理噪声的能力;其次,使用多头注意力机制,将序列数据中每个序列相对其他序列进行加权求和,提取数据的时序性;再次,将图注意力网络提取的节点特征与节点的度中心性拼接,获取节点的局部特征,并用全局平均池化的方式提取节点的全局特征;最后,将两者进行融合得到节点的最终特征表示,增强模型的表征能力.为验证改进图注意力网络的有效性,将改进图注意力网络模型与LSTM,GRU和GGNN模型进行对比,实验结果表明,该模型预测效果得到有效提升,具有更高的预测精度.Aiming at the problems that graph attention networks were weak in handling noisy and temporal data,as well as gradient explosion and oversmoothing after stacking multiple layers,we proposed an improved graph attention network model.Firstly,we used the Squeeze-and-Excitation module to pay different levels of attention to the feature information of the sample input data to enhance the model’s ability to handle noise.Secondly,the temporal sequence of the data was extracted by using the multi-head attention mechanism,which weighted and summed each sequence in the sequence data relative to the other sequences.Thirdly,the node features extracted from the graph attention network were spliced with the degree centrality of the nodes to obtain the local features of the nodes,and the global features of the nodes were extracted by using global average pooling.Finally,the two were fused to obtain the final feature representation of the nodes,which enhanced the representational ability of the model.In order to verify the effectiveness of the improved graph attention network,the improved graph attention network model was compared with LSTM,GRU and GGNN models.The experimental results show that the prediction effect of the model has been effectively improved,with higher prediction accuracy.
关 键 词:图注意力网络 多头注意力 节点度中心性 全局平均池化
分 类 号:TP18[自动化与计算机技术—控制理论与控制工程]
正在载入数据...
正在载入数据...
正在载入数据...
正在载入数据...
正在载入数据...
正在载入数据...
正在载入数据...
正在链接到云南高校图书馆文献保障联盟下载...
云南高校图书馆联盟文献共享服务平台 版权所有©
您的IP:216.73.216.49