“有声有色”的触觉体验:来自多感觉通道整合的线索  

The vivid tactile experience from vision and auditory:Clues from multisensory channel integration

作　　者：万必成 杨振[1] 李宏汀[1] 马舒 WAN Bicheng;YANG Zheng;LI Hongting;MA Shu(Psychology Department,Zhejiang Sci-Tech University,Hangzhou 310018,China)

机构地区：[1]浙江理工大学心理学系,杭州310018

出　　处：《心理科学进展》2022年第3期580-590,共11页Advances in Psychological Science

基　　金：浙江省自然科学基金/探索项目Q(LQ20C090010);浙江理工大学科研启动金(No.18062304-Y)资助。

摘　　要：虚拟现实技术通过提供视觉、听觉和触觉等信息为用户创造身临其境的感知体验,其中触觉反馈面临诸多技术瓶颈使得虚拟现实中的自然交互受限。基于多感官错觉的伪触觉技术可以借助其他通道的信息强化和丰富触觉感受,是目前虚拟现实环境中优化触觉体验的有效途径。本文聚焦于触觉中最重要的维度之一——粗糙度,试图为解决虚拟现实中触觉反馈的受限问题提供新思路。探讨了粗糙度感知中,视、听、触多感觉通道整合的关系,分析了视觉线索(表面纹理密度、表面光影、控制显示比)和听觉线索(音调/频率、响度)如何影响触觉粗糙度感知,总结了当下调控这些因素来改变粗糙度感知的方法。最后,探讨了使用伪触觉反馈技术时,虚拟现实环境中视、听、触觉信息在呈现效果、感知整合等方面与真实世界相比可能存在的差异,提出可借鉴的改善触觉体验的适用方法和未来待研究的方向。Virtual reality creates an immersive experience for users by providing visual,auditory,and tactile information.However,tactile feedback still faces many technical bottlenecks,which limit natural interaction in the virtual reality environment.Pseudo-haptic technology based on multi-sensory illusion can enhance and enrich tactile perception with the help of information from other channels,which is one of the effective ways to optimize tactile perception in the virtual reality environment.In order to explore the problem in a more targeted way,the study focuses on roughness perception among different dimensions of tactile perception.We discuss the multi-sensory channel integration of visual,auditory,and tactile in roughness perception,then analyze how the visual cues(density of surface texture,light and shadow,control display rate)and auditory cues(pitch/frequency,loudness)affect roughness perception,moreover,summarize the methods of changing roughness perception by manipulating these cues.Finally,we discuss the differences of visual,auditory,and tactile information between virtual reality environment and real-world in representation and perceptual integration when using pseudo-haptic feedback technology,proposing practical solutions and future research directions to improve the tactile experience.

关 键 词：粗糙度知觉 多感觉通道整合 视觉线索 听觉线索 

分 类 号：B842[哲学宗教—基础心理学]