面向指-笔混合输入的交互原语和交互模型研究  

Research on Interaction Primitives and Interaction Model for Pen+Touch Inputs

作　　者：仝青山 康文惠 付强 黄进[1] 田丰[1] 戴国忠[1] TONG Qing-Shan;KANG Wen-Hui;FU Qiang;HUANG Jin;TIAN Feng;DAI Guo-Zhong(Beijing Key Laboratory of Human-computer Interaction(Institute of Software,Chinese Academy of Sciences),Beijing 100190,China;School of Computer Science and Technology,University of Chinese Academy of Sciences,Beijing 100049,China)

机构地区：[1]人机交互北京市重点实验室(中国科学院软件研究所),北京100190 [2]中国科学院大学计算机科学与技术学院,北京100049

出　　处：《软件学报》2024年第4期2022-2038,共17页Journal of Software

基　　金：国家自然科学基金(62172397);中国科学院前沿基础研究重点项目(QYZDY-SSW-JSC041)。

摘　　要：随着触摸设备的普及,指、笔输入已成为移动办公的一种主流输入方式.然而现有的应用主要以手指或笔通道中的一种作为输入,限制了用户的交互空间.同时,现有的指-笔混合研究主要关注串行的指-笔分工协作和特定交互任务的并行处理,并没有系统地考虑并行协作机制和不同通道输入之间的意图关联.为此,提出一种面向指-笔混合输入的交互模型;结合用户指-笔协作的行为习惯定义指-笔混合交互原语,拓展指、笔交互空间;继而利用部分可观察马尔可夫决策过程提出基于时序信息的指-笔混合输入意图提取方法,用以增量式地提取多义性交互原语的交互意图.最后通过一个用户实验说明指-笔混合输入的优势.With the popularity of touch devices,pen+touch inputs have become mainstream input modes for mobile officing.However,existing applications mainly take one of them as input,which limits users’interaction space.In addition,existing pen+touch research mainly focuses on serial pen+touch cooperation and parallel processing of specific interactive tasks and does not systematically consider parallel cooperation mechanism and intention correlation between different inputs.This study first proposes an interaction model based on pen+touch inputs and then defines pen+touch interaction primitives according to users’behavioral habits in pen+touch cooperation,so as to extend pen+touch interaction space.Furthermore,by using a partially observable Markov decision process(POMDP),the study develops a method of extracting pen+touch input intentions based on time sequence information,so as to incrementally extract the interaction intention of polysemantic interaction primitives.Finally,the study evaluates the advantages of pen+touch inputs through a user experiment.

关 键 词：笔式交互 指-笔混合输入 交互空间 交互模型 

分 类 号：TP393[自动化与计算机技术—计算机应用技术]