BCCLR:A Skeleton-Based Action Recognition with Graph Convolutional Network Combining Behavior Dependence and Context Clues  

作　　者：Yunhe Wang Yuxin Xia Shuai Liu 

机构地区：[1]College of Information Science and Engineering,Institute of Interdisciplinary Studies,Hunan Normal University,Changsha,410081,China [2]School of Educational Sciences,Institute of Interdisciplinary Studies,Hunan Normal University,Changsha,410081,China

出　　处：《Computers, Materials & Continua》2024年第3期4489-4507,共19页计算机、材料和连续体（英文）

基　　金：supported in part by the 2023 Key Supported Project of the 14th Five Year Plan for Education and Science in Hunan Province with No.ND230795.

摘　　要：In recent years,skeleton-based action recognition has made great achievements in Computer Vision.A graph convolutional network(GCN)is effective for action recognition,modelling the human skeleton as a spatio-temporal graph.Most GCNs define the graph topology by physical relations of the human joints.However,this predefined graph ignores the spatial relationship between non-adjacent joint pairs in special actions and the behavior dependence between joint pairs,resulting in a low recognition rate for specific actions with implicit correlation between joint pairs.In addition,existing methods ignore the trend correlation between adjacent frames within an action and context clues,leading to erroneous action recognition with similar poses.Therefore,this study proposes a learnable GCN based on behavior dependence,which considers implicit joint correlation by constructing a dynamic learnable graph with extraction of specific behavior dependence of joint pairs.By using the weight relationship between the joint pairs,an adaptive model is constructed.It also designs a self-attention module to obtain their inter-frame topological relationship for exploring the context of actions.Combining the shared topology and the multi-head self-attention map,the module obtains the context-based clue topology to update the dynamic graph convolution,achieving accurate recognition of different actions with similar poses.Detailed experiments on public datasets demonstrate that the proposed method achieves better results and realizes higher quality representation of actions under various evaluation protocols compared to state-of-the-art methods.

关 键 词：Action recognition deep learning GCN behavior dependence context clue self-attention 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]