一种基于视觉的手指屏幕交互方法  

A Vision-Based Method for Finger-Screen Interaction

作　　者：徐一华[1] 李善青[1] 贾云得[1] 

机构地区：[1]北京理工大学计算机科学技术学院,北京100081

出　　处：《电子学报》2007年第11期2236-2240,共5页Acta Electronica Sinica

基　　金：国家自然科学基金(No.60473049);国家973重点基础研究发展计划(No.2006CB303105)

摘　　要：本文提出了一种新的基于视觉技术的手指屏幕交互方法,利用手指在屏幕上的移动和点击等动作完成与计算机的交互.该方法使用两个摄像头从不同视角实时拍摄计算机屏幕,结合人手肤色和轮廓信息对手指进行实时跟踪,并根据两幅图像中的指尖位置和摄像头参数来判断指尖是否接触屏幕.实验结果表明,该方法可以完成鲁棒的手指跟踪和准确的点击检测,对光照条件没有严格的限制,实现了自然友好的人机交互操作,可以运用于智能交互、数字娱乐、穿戴计算等多种应用场合.This paper presents a novel vision-based method for finger-screen interaction which achieves natural interactions through moving and clicking a single finger on a computer screen.The method uses two cameras at different viewpoints to capture video images covering the computer screen in real time.We integrate two cues of skin color and contour information to track finger＇ s motions in the framework of particle filter.The clicking actions on the screen surface are detected with the obtained fingertip positions and the geometry parameters of cameras.Experimental results demonstrate that the interactive method can realize robust tracking of finger motion,against complex background and varying illumination conditions,as well as the instant detection of finger clicking actions.This method achieves robust and natural human-computer interaction,and can be widely used in many applications,such as intelligent interaction,digital entertainment and wearable computing environment.

关 键 词：手指跟踪 手指屏幕交互 人机交互 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]