基于多头自注意力机制的大气数据系统多故障识别  

Multi-fault recognition of air data system based on multi-head self-attention mechanism

作　　者：王力[1] 金辉 WANG Li;JIN Hui(Vocational and Technical Institute,Civil Aviation University of China,Tianjin 300300,China;College of Electronic Information and Automation,Civil Aviation University of China,Tianjin 300300,China)

机构地区：[1]中国民航大学职业技术学院,天津300300 [2]中国民航大学电子信息与自动化学院,天津300300

出　　处：《江苏大学学报（自然科学版）》2023年第4期444-451,共8页Journal of Jiangsu University：Natural Science Edition

基　　金：国家自然科学基金资助项目(U1733119);中央高校基本科研业务费资助项目(3122017107)。

摘　　要：针对大气数据具有时变性强、类型多、故障复杂等问题,提出一种基于多头自注意力机制的故障诊断方法.首先,使用LSTM提取故障数据的时域特征;然后,结合MSA提取不同类型数据间的空间位置特征;最后,利用MLP提升模型泛化能力,给出了故障诊断流程.该方法在不同类型数据间形成故障互判,实现多故障识别,并利用大气数据对该方法有效性进行充分验证.给出了试验设置,采用带k折交叉验证的网格搜索法确定最优模型参数;为验证LSTM-MSA模型的性能,构建MSA-LSTM、LSTM-MSA-P、LSTM-CNN、RNN-MSA共4种深度学习模型进行对比试验;为验证诊断模型能否精确定位故障,使用验证集的预测标签和真实标签构建故障分类混淆矩阵;为进一步验证文中方法的诊断能力,基于t-SNE进行了可视化试验.结果表明,所提出方法的故障识别准确率达96.696%,F1达96.777%,且各类故障的误判率均控制在10%以下,诊断模型具有较高的鲁棒性.To solve the problems of strong time-varying,multiple types,complex faults in the air data,a fault diagnosis method was proposed based on the multi-head self-attention mechanism.The long short term memory(LSTM)was used to extract the time domain features of the faulty data,and the multi-head self-attention(MSA)was combined to extract the spatial location features between different types of data.The multilayer perceptron(MLP)was used to improve the generalization ability of the model,and the troubleshooting process was given.By the method,the fault mutual judgements between different types of data were obtained to realize multiple fault identification,and the method was fully verified by the atmospheric data.The experimental setup was given,and the grid search method with k-fold crossvalidation was used to determine the optimal model parameters.To verify the performance of LSTM-MSA model,four deep learning models of MSA-LSTM,LSTM-MSA-P,LSTM-CNN and RNN-MSA were constructed for comparison experiments.To verify whether the diagnostic model can pinpoint faults,the fault classification confusion matrix was constructed using the predicted and true labels of the validation set.To further verify the diagnostic capability of the method,the visualization experiments were conducted based on t-SNE.The results show that the fault recognition accuracy of the proposed method is 96.696%with F,of 96.777%,and the misclassification rates of all kinds of faults are controlled below 10%,which illuminates that the diagnosis model has high robustness.

关 键 词：大气数据系统 故障诊断 深度学习 故障仿真 长短期记忆 多头自注意力机制 

分 类 号：TP183[自动化与计算机技术—控制理论与控制工程] V271.1[自动化与计算机技术—控制科学与工程]