基于视觉的投影-摄像机指尖触控系统  

Vision-Based Fingertip Interactive Projector-Camera System

作　　者：宋呈群[1] 程俊[1] SONG Chengqun CHENG Jun(Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China)

机构地区：[1]中国科学院深圳先进技术研究院,深圳518055

出　　处：《集成技术》2017年第1期8-15,共8页Journal of Integration Technology

基　　金：国家自然科学基金项目(61403365);中国博士后科学基金(2016M602543);广东省科技发展专项资金(2016B010108010);广东省自然科学基金项目(2015A030313744);深圳科技计划(JCYJ20140901003939013);深圳市技术攻关项目(JSGG20160331185256983)

摘　　要：文章提出了一种基于视觉的投影交互方法,通过判断用户手指与其在屏幕上投射阴影的融合程度来检测投影屏幕上是否有触控事件发生。为提升系统的鲁棒性,在检测阶段,将手指与其阴影同时从相机图像中分割出来,进而采用一种线性模型判断方法来判定手指与其阴影的融合程度,如果判定触碰事件发生,则通过指尖位置检测来判断触控的具体位置。该方法不需要用户使用任何辅助工具,即可用手指在投影屏幕上直接与显示画面实现交互操作。A vision-based fingertip interactive projector-camera system was presented in this paper. The proposed method can detect touch operations by judging the fusion level of fingertip and its shadow. To improve the robustness of the proposed method, in image detection stage, finger and its shadow are extracted and segmented from the image separately. And then, a linear detection model was introduced to judge the fusing level of fingertip and its shadow in the image. While a touching event was detected, the touching location can be calculated from the extracted fingertip image coordinate. With the proposed method, users can realize finger-based operation on the projector screen without any accessory tools.

关 键 词：投影-摄像机系统 人机交互 前景提取 手势识别 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]