基于中粒度模型的视频人体姿态估计  

A Medium Granularity Model for Human Pose Estimation in Video

作　　者：史青宣 邸慧军[1,3] 陆耀 田学东[2] SHI Qing-Xuan;DI Hui-Jun;LU Yao;TIAN Xue-Dong(School of Computer Science, Beijing Institute of Technology, Beijing 100081;School of Cyber Security and Computer, Hebei University, Baoding 071000;Beijing Laboratory of Intelligent Information Technology, Beijing 100081)

机构地区：[1]北京理工大学计算机学院,北京100081 [2]河北大学网络空间安全与计算机学院,保定071000 [3]智能信息技术北京市重点实验室,北京100081

出　　处：《自动化学报》2018年第4期646-655,共10页Acta Automatica Sinica

基　　金：国家自然科学基金(61375075;9142020013;61273273);河北省高等学校科学技术研究重点项目(ZD2017208)资助~~

摘　　要：人体姿态估计是计算机视觉领域的一个研究热点,在行为识别、人机交互等领域均有广泛的应用.本文综合粗、细粒度模型的优点,以人体部件轨迹片段为实体构建中粒度时空模型,通过迭代的时域和空域交替解析,完成模型的近似推理,为每一人体部件选择最优的轨迹片段,拼接融合形成最终的人体姿态序列估计.为准备高质量的轨迹片段候选,本文引入全局运动信息将单帧图像中的最优姿态检测结果传播到整个视频形成轨迹,然后将轨迹切割成互相交叠的固定长度的轨迹片段.为解决对称部件易混淆的问题,从概念上将模型中的对称部件合并,在保留对称部件间约束的前提下,消除空域模型中的环路.在三个数据集上的对比实验表明本文方法较其他视频人体姿态估计方法达到了更高的估计精度.Human pose estimation has attracted much attention in the computer vision community due to its potential applications in action recognition, human-computer interaction, etc. To focus on pose estimation in videos, a medium granularity spatio-temporal probabilistic graphical model using body part tracklets as entities is presented in this paper.The optimal tracklet for each body part is acquired by spatiotemporal approximate reasoning through iterative spatial and temporal parsing, and the final human pose estimation is achieved by merging these optimal tracklets. To generate reliable tracklet proposals, global motion cue is adopted to propagate pose detections from individual frames to the whole video,and the trajectories from this propagation are segmented into fixed-length overlapping tracklets. To deal with the double counting problem, symmetric parts are coupled to one virtual node, so that the loops in spatial model are removed and the constaints between symmetric parts are maintained. The experiment on three datasets shows the proposed method achieves a higher accuracy than other pose estimation methods.

关 键 词：人体姿态估计 中粒度模型 马尔科夫随机场 隐马尔科夫模型 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]