基于普通纸笔的投影交互方法研究  

Research on projector interaction method with common pen and paper

作　　者：郭俊修 柳有权[1] 王松雪 GUO Jun-xiu;LIU You-quan;WANG Song-xue(School of Information Engineering,Chang’an University,Xi’an Shaanxi 710064,China)

机构地区：[1]长安大学信息工程学院,陕西西安710064

出　　处：《图学学报》2021年第3期470-477,共8页Journal of Graphics

基　　金：载人航天预研项目(030101)。

摘　　要：投影交互使交互空间不再局限于屏幕,与其他方式相比具有更好的用眼舒适度,能够实现丰富的交互效果,而笔式书写交互则有着与生俱来的自然性和高效性。结合二者优点,提出了一种基于普通纸笔的投影交互方法,通过普通纸笔与计算机进行交互,摄像头用于采集手写内容,投影仪则用于识别效果呈现。另外,通过卷积神经网络(CNN)和KNN结合使系统可自动适应用户的手写风格,提高了针对不同用户的手写体识别率。在此基础上,针对教育领域设计了单词拼写和算式计算2个典型应用。经实验和用户调查,该交互方法与其他交互方法相比,更舒适自然,具有较强的实用性。Projector interaction has freed the interaction space from the electronic screen,which is more eye-friendly than other display modes and can produce abundant interesting interaction effects.In addition,the interaction with pen-writing is inherently natural and efficient.With the integration of the advantages of both,a projection interactive method was proposed based on common pen and paper.Users can interact with the computer through common paper and pen,while the camera was employed to collect the handwriting images,and projector was utilized to present recognition result.Moreover,with the integration of CNN and KNN,the present method can automatically adapt to users’handwriting style,so as to increase the recognition accuracy.Based on this,two typical applications are designed,including English-word remembering and simple mathematical calculation.The experiments and user surveys verified that the proposed interaction method is more natural,convenient and practical than other interaction methods.

关 键 词：普通纸笔 投影交互 手写体识别 笔式交互 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]