增强现实环境下的人手自然交互  

Hand Based Natural Interaction in Augmented Reality

作　　者：孙超[1] 张明敏[1] 李扬[1] 汤兴[2] 潘志庚[1] 

机构地区：[1]浙江大学CAD&CG国家重点实验室,杭州310058 [2]英特尔亚太研发中心,上海200241

出　　处：《计算机辅助设计与图形学学报》2011年第4期697-704,共8页Journal of Computer-Aided Design & Computer Graphics

基　　金：国家自然科学基金(60970076);国家科技部世博专项(2009BAK43B07);英特尔-高校合作研究项目

摘　　要：为了实现增强现实环境下的自然人手3D交互,提出一套针对不佩戴任何标记的人手的3D交互算法.该算法经过区域检测跟踪、特征点提取和3D稀疏结构重建等步骤获取人手的3D结构;在此基础上提出基于指尖、指向和手掌平面的人手3D交互模式;将从真实世界提取的3D交互信息对齐到虚拟世界,融合渲染并触发交互,实现自然人手3D交互.实验结果表明,该算法具有较高的沉浸感、精确度和易用性.In order to achieve hand based natural behavior interaction in augmented reality, this paper proposes a 3D interaction algorithm for marker-free hand. This algorithm uses a series of steps of hand detection, hand feature extraction and hand 3D structure reconstruction to get 3D structure of a bare hand. Based on this, we extract 3 basic 3D interaction modes of hand： point, line and plane in real world and align them in the virtual world to achieve hand based natural behavior 3D interaction in the environment of augmented reality. This paper also presents experimental results to verify the superior performance, accuracy and flexibility of the proposed approaches.

关 键 词：增强现实 三维交互 特征提取 多视几何 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]