基于Kinect的中国手语识别  

Chinese sign language recognition based on the Kinect

作　　者：杨勇[1] 叶梅树 

机构地区：[1]重庆邮电大学计算机科学与技术研究所,重庆400065

出　　处：《重庆邮电大学学报（自然科学版）》2013年第6期834-841,849,共9页Journal of Chongqing University of Posts and Telecommunications(Natural Science Edition)

基　　金：重庆市自然科学基金(CSTC;2007BB2445);重庆市教委科学技术研究项目(KJ110522);重庆邮电大学科研基金(A2009-26)~~

摘　　要：基于微软Kinect提取的深度图像信息,提出了一种新的中国手语识别方法。该方法首先利用Kinect获取人体主要骨骼的3D坐标和手的3D坐标;然后根据中国手语的手型、手的位置和手的方向3个主要构造成分,分别采用DBSCAN和K-means聚类算法获取手语特征中的手的位置基元和方向基元,提出一种结合CLTree和Attribute bagging聚类集成方法提取手型基元;最后将这3类基元进行组合采用模板匹配方法识别中国手语。通过对选取的72个中国手语进行识别实验,平均识别率为90.35%,实验结果说明了方法的可行性。Abstract： A novel recognition method for Chinese sign language based on depth information extracted from the Microsoft Kineet is proposed in this paper. At first, the 3-D features of skeletons of mainbody and palms would be extracted based on Kinect. Secondly, the Chinese sign language can be seen composed by three components, that is, hand shape, location and hand orientation. The DBSCAN and K-means algorithms are used to extract the location subwords and orientation sub- words respectively, a cluster ensemble method combined CLTree and Attribute bagging is proposed to extract the shape sub- words. At last, the three subwords are combined together, and template matching method is used as a recognition method. The experimental results show that the average recognition rate is 90.35% on 72 Chinese signs, and the proposed method is proved to be effective.

关 键 词：中国手语识别 基元 聚类 KINECT 

分 类 号：TP18[自动化与计算机技术—控制理论与控制工程]