Judging the Normativity of PAF Based on TFN and NAN  

作　　者：LI Zhiqiang BAO Jinsong LIU Tianyuan WANG Jiacheng 李志强;鲍劲松;刘天元;王佳诚(College of Mechanical Engineering,Donglma University,Shanghai 201600,China)

机构地区：[1]College of Mechanical Engineering,Donglma University,Shanghai 201600,China

出　　处：《Journal of Shanghai Jiaotong university(Science)》2020年第5期569-577,共9页上海交通大学学报（英文版）

基　　金：the National Natural Science Foundation of China(No.51475301)。

摘　　要：The normativity of workers'actions during producing has a great impact on the quality of the products and the safety of the operation process.Previous studies mainly focused on the normativity of each single producing action instead of considering the normativity of continuous producing actions,which is defined as producing action flow(PAF)in this paper,during operation process.For this issue,a normativity judging method based on two-LSTM fusion network(TFN)and normativity-aware attention network(NAN)is proposed.First,TFN is designed to detect and recognize the producing actions based on skeleton sequences of a worker during complete operation process,and PAF data in sequential form are obtained.Then.NAN is built to allocate difTerent levels of attention to each producing action within the sequence of PAF.and by this means,an efficient normativity judging is conducted.The combustor surface cleaning(CSC)process of rocket engine is taken as the experimental case,and the CSC-Action2D dataset is established for evaluation.Experiment results show the high performance of TFN and NAN.demonstrating the effectiveness of the proposed method for PAF normativity judging.

关 键 词：producing action normativity sequential model attention mechanism deep learning 

分 类 号：TP391.7[自动化与计算机技术—计算机应用技术]