基于TLSHOG特征新方法的动态手势识别  

Novel method for dynamic hand gesture recognition based on Temporal Locality Sensitive Histograms of Oriented Gradients

作　　者：陈睿敏[1,2] 孙胜利[1] 廖星星[1] CHEN Ruimin;SUN Shengli;LIAO Xingxing(Shanghai Institute of Technical Physics,Chinese Academy of Sciences,Shanghai 200080,China;School of Information Science and Technology,ShanghaiTech University,Shanghai 200120,China)

机构地区：[1]中国科学院上海技术物理研究所,上海200080 [2]上海科技大学信息科学与技术学院,上海200120

出　　处：《计算机工程与应用》2018年第13期142-147,共6页Computer Engineering and Applications

基　　金：中科院上海技术物理研究所2015年所创新专项(No.CX-63)

摘　　要：为了提高实际复杂场景的人机交互中动态手势识别的准确性和实时性,提出了一种时序局部敏感直方图(Temporal Locality Sensitive Histograms of Oriented Gradients,TLSHOG)特征新方法,用于描述手势运动的时序变化和空间姿态,实现了快速而精确的动态手势识别。采用普通网络摄像头获取手部的二维图像序列作为训练样本,然后构造单帧图像特征描述手部的空间姿态,并结合时间金字塔(Temporal Pyramid,TP)来描述手势运动轨迹的时空特征,运用多维支持向量机(Support Vector Machine,SVM)算法进行模型训练,对测试样本中的多种手势进行精确的分类。实验结果表明,该方法准确度高,实时性好,对于复杂背景干扰、光照强度变化有较强的鲁棒性。In order to improve the performance of dynamic hand gesture recognition in complex real scenes for humancomputer interaction, a novel method named Temporal Locality Sensitive Histograms of Oriented Gradients（TLSHOG）is proposed to represent sequential variations and changeable spatial postures of human hands. And it certainly achieves effective dynamic hand gesture recognition in real time. Firstly, a training set for machine learning is established by recording several videos of human hands using normal PC cameras. After that, a single-frame feature is proposed to describe the spatial feature of hands, and a Temporal Pyramid（TP）method is further applied to describe the trajectories of dynamic hand gestures. At last, a multidimensional Support Vector Machine（SVM）classifier is build, and all dynamic hand gestures in testing set are then correctly recognized. The experimental results indicate that this new method is highly discriminative of dynamic hand gestures and robust to effects of complex backgrounds and illuminations.

关 键 词：动态手势 局部敏感 梯度方向直方图 时空特征 

分 类 号：TP18[自动化与计算机技术—控制理论与控制工程]