基于Kinect的实时稳定的三维多手指跟踪算法  

Real Time Robust Multi-fingertips Tracking in 3DSpace Using Kinect

作　　者：晏浩[1] 张明敏[1] 童晶[1,2] 潘志庚[1,3] 

机构地区：[1]浙江大学CAD&CG国家重点实验室,杭州310058 [2]河海大学物联网工程学院,常州213022 [3]杭州师范大学数字媒体与人机交互研究中心,杭州310012

出　　处：《计算机辅助设计与图形学学报》2013年第12期1801-1809,共9页Journal of Computer-Aided Design & Computer Graphics

基　　金：国家自然科学基金(61173124,61202284)

摘　　要：针对现有手指跟踪算法的不足,利用微软Kinect设备提出一种实时鲁棒的三维多手指跟踪算法.首先利用深度图分割出一个粗糙的手区域,对该区域应用基于像素分类的指尖检测算法得到二维指尖点的位置;然后在深度图上对二维指尖位置周围的点进行采样,将均值作为指尖点的Z坐标,再利用卡尔曼滤波器以及帧之间的连续性对指尖点的三维位置进行跟踪.依据Kinect数据特点提出的二维指尖检测算法和利用帧之间连续性的卡尔曼滤波器是文中算法的关键.实验结果证明,该算法能够实时、稳定地进行三维多手指跟踪.In this paper, we introduce a fast and robust algorithm for tracking 3D multi-fingertips using Kinect. Our method firstly uses Kinect to get a rough hand region, then applies the fingertip detection method based on pixel classification to get the 2D fingertips. Finally, we sample on the depth map around the detected fingertip to get the Z-value of the fingertips and then combine the Kalman filter and the continuity between frames to track the 3D position of fingertips. The fingertip detection method based on the specialty of the data of Kinect and the Kalman filter applied with continuity between frames are the key of our algorithm. The experimental results show that our algorithm can robustly track 3D multi-fingertips in real time.

关 键 词：多手指跟踪 3D人机交互 KINECT 

分 类 号：TP391.4[自动化与计算机技术—计算机应用技术]