视听触同步刺激的数字化盲文学习方法  

Digital Braille Learning Method Based on Simultaneous Stimuli of Vision,Audition,and Touch

作　　者：陈楷闻 林栋 钟泽栋 胡庆玲 吴新丽[1] 刘瑜[1] 杨文珍[1,2] CHEN Kai-Wen;LIN Dong;ZHONG Ze-Dong;HU Qing-Ling;WU Xin-Li;LIU Yu;YANG Wen-Zhen(Faculty of Mechanical Engineering and Automation,Zhejiang Sci-Tech University,Hangzhou 310018,China;Research Center for Smart Sensing,Zhejiang Lab,Hangzhou 311121,China)

机构地区：[1]浙江理工大学机械与自动控制学院,杭州310018 [2]之江实验室超级感知研究中心,杭州311121

出　　处：《计算机系统应用》2021年第9期262-270,共9页Computer Systems & Applications

基　　金：国家重点研发计划(2018YFB1004901);浙江省基础公益研究计划(LGF19E050005);之江实验室重点研发项目(2019MC0AD01);浙江省自然科学基金(LY20F020019,LQ19F020012,LQ20F020001)。

摘　　要：盲文是视障人士获取信息,学习知识的重要媒介.然而,目前基于纸质书籍的盲文学习方法只能提供盲文点位的触觉刺激,存在不便携、不易用且内容陈旧等问题.为此,本文提出了一种视觉、听觉和触觉同步刺激的数字化盲文学习方法,能够提高视障人士的盲文学习效率.基于多感知盲文学习机,本文设计了一种多感知信息匹配算法,能够输出文字、声音和盲文点位相同内容的信息,为视障人士无障碍学习盲文提供条件.短期记忆的盲文学习效果实验表明:(1)在视觉、听觉和触觉的共同刺激下,盲文学习效率最高,即在盲文学习过程中,增加视觉刺激对于视力残余人士提升盲文学习效率有显著正向促进作用;(2)在听觉和触觉的共同刺激下,盲文学习效率并不高,即全盲人士学会盲文有一定难度,需要有较长的学习曲线;(3)仅在听觉刺激下,盲文学习效率很低,即开发语音学盲文的APP不具备实践意义.Braille is an important medium for visually impaired people to get information and learn knowledge.Because the traditional paper-based braille learning method only presents braille by tactile stimuli,it is hard for visually impaired people to master braille.The paper braille documents are too cumbersome to use,and their content cannot be refreshed.To improve the braille learning efficiency,we propose a digital braille learning method based on synchronous stimuli of vision,audition,and touch.On a braille learning machine with the functions of multi-sensorial channels,we design an information matching algorithm for text,sound,and braille dots.This method can synchronously output visual,auditory,and tactile stimuli,which provides reasonable conditions for visually impaired people to learn braille efficiently.With the short-term memory research method,the experimental results are as follows:(1)The braille learning efficiency is the highest with the combination of visual,auditory,and tactile stimuli;thus,for people with weak vision,the visual stimulus is powerful to improve their braille learning efficiency.(2)The braille learning efficiency is lower with the combination of auditory and tactile stimuli,and thus it is hard for the blind to master braille in a short period.(3)The braille learning efficiency is very low with only the auditory stimulus;thus,APP only providing auditory stimulus to learn braille is less useful.

关 键 词：盲文 多感知通道 信息匹配算法 视障人士 

分 类 号：TP391.43[自动化与计算机技术—计算机应用技术] TN912.3[自动化与计算机技术—计算机科学与技术]