面向行为识别的人体空间协同运动结构特征表示与融合  

Structural feature representation and fusion of behavior recognition oriented human spatial cooperative motion

作　　者：莫宇剑 侯振杰[1] 常兴治[2] 梁久祯[1] 陈宸 宦娟[1] MO Yujian;HOU Zhenjie;CHANG Xingzhi;LIANG Jiuzhen;CHEN Chen;HUAN Juan(School of Information Science and Engineering,Changzhou University,Changzhou 213164,China;Open Lab of Industrial Cloud for Intelligent Manufacturing,Changzhou College of Information Technology,Changzhou 213164,China;Department of Electrical and Computer Engineering,University of North Carolina at Charlotte,Charlotte 28223,USA)

机构地区：[1]常州大学信息科学与工程学院,常州213164 [2]常州信息职业技术学院智能制造工业云开放实验室,常州213164 [3]北卡罗来纳大学夏洛特分校电气与计算机工程系,夏洛特市28223

出　　处：《北京航空航天大学学报》2019年第12期2495-2505,共11页Journal of Beijing University of Aeronautics and Astronautics

基　　金：国家自然科学基金(61063021,61803050);江苏省物联网移动互联技术工程重点实验室开放课题(JSWLW-2017-013)~~

摘　　要：针对人体执行动作时不同身体部位之间的协同关系,提出了基于人体空间协同运动结构特征的行为识别方法。首先度量人体不同部位对完成动作的贡献度,并将不同部位的贡献度转变为协同运动结构特征模型。然后利用模型无监督、自适应地对不同身体部位的运动特征进行约束。在此基础上借鉴跨媒体检索方法JFSSL对不同模态的特征进行特征选择与多模态特征融合。实验表明,所提方法在自建的行为数据库上明显提高了开放测试的识别率,且计算过程简便,易于实现。In view of the synergistic relationship among different parts of the body when human body performs actions,a behavior recognition method based on human body spatial cooperative motion structural features is proposed.Firstly,the contribution of different parts of the human body to the completion of the action is measured,and the contribution of different parts of the human body is transformed into a structural feature model of cooperative motion.Then,the model is used to constrain the motion characteristics of different parts of the body self-adaptively without supervision.On this basis,feature selection and multi-modal feature fusion are carried out using JFSSL,a cross-media retrieval method.The experiments show that the recognition rate of the open test is obviously improved by the proposed method on the self-built behavior database.At the same time,the calculation process of the method is simple and easy to implement.

关 键 词：贡献度度量 协同运动 结构特征 特征选择 多模态融合 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]