融合视觉线索的多模态信息界面复杂度优化研究  

Optimization of Complexity in Multimodal Information Interfaces with Integrated Visual Cues

作　　者：张晶 施行健 钱龙泷 储晴 ZHANG Jing;SHI Xingjian;QIAN Longlong;CHU Qing(College of Furnishings and Industrial Design,Nanjing Forestry University,Nanjing 210037,China;Dehua Tubao New Decoration Material Co.,Ltd.,Zhejiang Huzhou 313299,China)

机构地区：[1]南京林业大学家居与工业设计学院,南京210037 [2]德华兔宝宝装饰新材股份有限公司,浙江湖州313299

出　　处：《包装工程》2025年第4期36-48,95,共14页Packaging Engineering

基　　金：国家自然科学青年基金资助项目(72201128);中国博士后科学基金资助项目(2023M730483)。

摘　　要：目的针对多模态信息界面中的信息承载量与用户认知容量冲突造成的复杂度问题,引入认知层面的视觉线索设计,探究视觉线索的融入对多模态信息界面复杂度的优化作用。方法采用眼动追踪技术,收集了35名被试在不同视觉线索形式与高、中、低三种界面复杂度编码形式下的眼动数据和行为数据,提取兴趣区域内的总访问持续时间、眼跳次数、凝视次数等眼动指标并进行综合分析。结果多模态信息界面中的视觉线索和界面复杂度均对被试的行为反应指标和眼动指标有显著性影响,且动态线索和面形线索的视觉搜索绩效更优。结论视觉线索的融入可以在同等复杂度水平上有效引导被试的视觉动线,辅助被试快速有效地找到目标信息,不仅可以提升多模态信息界面的认知绩效,还有助于降低高复杂度界面中的认知难度。本研究结果可用于指导多模态信息界面的设计研发,为多模态信息界面复杂度的优化提供依据。In order to solve the complexity problem caused by the conflict between the information capacity and the user's cognitive capacity in multimodal information interfaces,the work aims to introduce visual clue design at the cogni-tive level and explore the effect of integrating visual clues on optimizing the complexity of multimodal information inter-faces.The eye-tracking technology was used to collect eye movement data and behavioral data from 35 subjects under dif-ferent visual cue forms and three interface complexity levels of high,medium and low.Eye movement indicators such as Total Visit Duration,Saccade Count,and Scanning Paths in the AOI were extracted for comprehensive analysis.Both visual cues and interface complexity in multimodal information interfaces had a significant impact on subjects'behavioral re-sponse indicators and eye movement indicators,and the visual search performance of dynamic cues and surface cues was better.The integration of visual cues can effectively guide the subjects'visual movement at the same level of complexity,helping them to find the target information more quickly and effectively,which can not only improve the cognitive performance of multimodal information interfaces,but also help reduce the cognitive difficulty in high-complexity interfaces.The results of this study provide a basis for optimizing the complexity of multimodal information interfaces.

关 键 词：多模态信息 界面复杂度 视觉线索 眼动实验 界面优化 

分 类 号：TB482[一般工业技术—包装工程] TP31[自动化与计算机技术—计算机软件与理论]