基于深度学习的人体骨架动作识别  

Human Skeleton-based Action Recognition Based on Deep Learning

作　　者：邬倩 吴飞[1] 骆立志 WU Qian;WU Fei;LUO Lizhi(School of Electronic and Electrical Engineering,Shanghai University of Engineering Science,Shanghai 201620,China)

机构地区：[1]上海工程技术大学电子电气工程学院,上海201620

出　　处：《电子科技》2020年第11期79-83,共5页Electronic Science and Technology

基　　金：国家自然科学基金(61272097);上海市科技学术委员会重点项目(18511101600)。

摘　　要：基于人体骨架的动作识别具有鲁棒性和视点不变性的优点,为进一步提高骨架动作识别的识别率,打破以往大部分基于深度学习的方法的输入内容为人体关节坐标的局限性,文中提出一种将几何特征与LSTM网络结合的人体骨架动作识别算法。该算法选择基于关节与选定直线之间距离的几何特征作为网络的输入,引入了一种时间选择LSTM网络进行训练。利用时间选择LSTM网络拥有选出最具识别性时间段特征的能力,在SBU Interaction数据集和UT Kinect数据集上分别取得了99.36%和99.20%的识别率。实验结果证明了该方法对人体骨架动作识别的有效性。Based on the advantages of robustness and view-invariant representation,a skeleton-based action recognition algorithm combining geometric features with LSTM network is proposed to further improve the recognition rate and to break the limitation that the inputs of most methods based on deep learning are human joint coordinates.The geometric features based on the distances between joints and selected lines are selected as the input of the network.Then,time-selective LSTM network is introduced to train.Time selection LSTM network has the ability to select the most recognizable time period features.By using this feature,99.36%and 99.20%recognition rates are achieved on SBU Interaction dataset and UT Kinect dataset,respectively.The experimental results show that the method is effective for human skeleton-based action recognition.

关 键 词：动作识别 人体骨架 深度学习 几何特征 时间选择 LSTM网络 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]