面向馆藏数字资源的多模交互模型与影响因素研究  

Research on Multi-Mode Interaction Model and Influencing Factors for Digital Collections

作　　者：祁彬斌 张文梅 朱学芳[3] 张慕华 李巧英 Qi Binbin;Zhang Wenmei;Zhu Xuefang;Zhang Muhua;Li Qiaoying(Smart Learning Institute,Beijing Normal University,Beijing 100875;Distance Education Research Center,Beijing Normal University,Beijing 100875;School of Information Management,Nanjing University,Nanjing 210023;College of Elementary Education,Capital Normal University,Beijing 100048)

机构地区：[1]北京师范大学智慧学习研究院,北京100875 [2]北京师范大学远程教育研究中心,北京100875 [3]南京大学信息管理学院,南京210023 [4]首都师范大学初等教育学院,北京100048

出　　处：《图书情报工作》2023年第5期90-98,共9页Library and Information Service

基　　金：中国博士后科学基金项目“基于触觉互联网的动作技能类教学交互模型与应用研究”(项目编号:2021M690432)和教育部人文社会科学研究青年项目“沉浸式虚拟现实学习环境中认知负荷的多维测评和干预策略研究”(项目编号:21YJC880095)研究成果之一。

摘　　要：[目的/意义]面对数字资源的智能化、可感知、沉浸式和可互动的未来趋势,三维实体、全景视频等新型资源形态成为记载和传播知识的重要形式。以往用户界面模型难以较好地支撑图博档等公共机构的互动情境式数字文化服务,公众需求和交互情境更迭呼唤沉浸体验、自然流畅的新型交互界面。[方法/过程]通过对数字馆藏资源与服务、多模交互界面与体验的相关问题进行探讨,提出面向馆藏数字资源的多模交互界面模型;多模交互的信息交换过程须以人的信息加工能力为约束,通过给出多模交互的信息加工模型,剖析虚拟现实情境下馆藏资源的用户交互认知过程。立足面向馆藏资源的多模交互模型,基于“界面-认知-情境”递进逻辑,分析影响用户交互体验的关键因素。[结果/结论]面向馆藏数字资源的多模交互界面模型应由交互模态、交互原语、交互任务三个关联递进的层级构成,以人为核心的多模交互可在多模感知、思维决策和交互执行等阶段增强人类的认知能力。沉浸流畅的用户交互体验取决于界面感知交互模态、心智模型匹配程度、交互情境沉浸维度等关键因素,可为多模交互设计、数字文化服务开展等提供参考。[Purpose/Significance]In recent years,there has been a trend toward digital collections,that are multisensory,realistic,and interactive.New resource forms such as 3D collections and panoramic videos have become important forms of recording and disseminating knowledge.It is difficult to support these situation-based interactive digital cultural services of public institutions by traditional user interface,such as libraries,museums and archives.Therefore,public needs and expanding interactive situations call for the new user interface with immersive and natural characteristics.[Method/Process]Based on the discussion of the related issues on digital collection resources and services,multi-mode interface and experience,this paper proposed the multi-modal interface model for digital collections.Based on the information processing model of multi-modal interaction,the information exchange process of multi-mode interaction should be constrained by people’s information processing ability.By giving a multi-mode interactive information processing model,the interactive cognition process of collection resources in virtual reality is analyzed.Then,based on the multi-mode interaction model for collection resources,according to the progressive logic of“interface-cognition-context”,this study analyzed the key factors affecting user experience(UE).[Result/Conclusion]The multi-mode interaction interface for digital collections is composed of 3 progressive levels of interaction modality,interaction primitive and interaction task.Human-centered multi-mode interaction could enhance human’s cognitive abilities in the stages of multi-mode perception,thinking decision-making and interactive execution.The key influencing factors of immersive UE involve perceptual and interactive modality,matching degree of mental model,immersion dimension of interaction scenario,which can provide reference for multimode interaction design as well as digital culture services.

关 键 词：馆藏数字资源 虚拟现实 多模交互 用户体验 数字文化服务 元宇宙 

分 类 号：G202[文化科学—传播学] G250.7