基于自然手势跟踪的直接操作型三维人机交互范式  

3D Direct Human-Computer Interface Paradigm Based on Free Hand Tracking

作　　者：冯志全[1,2] 杨波[1,2] 徐涛[1,2] 唐好魁[1,2] 吕娜[1,2] 

机构地区：[1]济南大学信息科学与工程学院,济南250022 [2]山东省网络环境智能计算技术重点实验室,济南250022

出　　处：《计算机学报》2014年第6期1309-1323,共15页Chinese Journal of Computers

基　　金：国家自然科学基金(61173079;61173078);山东省自然科学基金重点项目(ZR2011FZ003)资助

摘　　要：针对自然手势单通道条件下建立统一交互模型的难点问题和关键问题,该文提出一种基于二级行为模型的3D手势跟踪和交互方法,实现了一种基于自然手势的直接操作型3D人机交互界面范式原型系统.首先,建立了二级行为模型,然后,以行为模型为基础,设计并实现了一种基于行为模型的三维人机交互界面范式.文中主要创新点在于:建立了基本手势库的二级行为模型;用"令牌环"技术捕捉用户的交互意图;建立"多选一"的交互模型;用"替身"技术解决人手模型与不同物体的抓取过程中的多样性和复杂性问题,建立了抓取和释放操作的统一范式并提出了相关算法.文中算法在多个交互型虚拟装配平台上得到了验证.实验结果表明,与现有相关算法相比较,文中算法在时间开销和跟踪精度等方面得到了明显改善.Directed at some of the difficult problems and key problems in building uniform human computer interaction model under the single channel or free gesture input,a new tracking and interacting method for three-dimensional （3D） gesture based on a two level behavioral model is put forward in this paper.First of all,the two level behavioral model is built upon which a 3D human computer interface paradigm is designed.The main contributions of this paper are as follows.（1） The two level behavioral model for a basic gesture database is built; （2） capture interaction intention of users with token-ring,so as to form the interaction model for choosing an object from multiples; （3） replace objects with proxies to solve complexity and diversity for 3D hand model to grasp objects with different shapes and sizes.The proposed algorithm has been tested on several virtual assembling platforms.Experimental results with real video data show the efficiency and effectiveness of the new approach.This research also provides us a natural,direct,convenient and harmonious human-computer interaction paradigm.

关 键 词：三维手势跟踪 人机交互界面 行为模型 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]