一种基于可穿戴器件触觉感知信息的盲人虚拟视觉导航系统  

A Virtual Vision Navigation System for The Blind Using Wearable Touch-vision Devices

作　　者：葛松 林衍旎 赖舜男 徐晶晶 何宇力 赵琦[3] 张弘[4] 许胜勇[1] GE Song;LIN Yan-Ni;LAI Shun-Nan;XU Jing-Jing;HE Yu-Li;ZHAO Qi;ZHANG Hong;XU Sheng-Yong(School of Electronics,Peking University,and Key Laboratory for the Physics&Chemistry of Nanodevices,Beijing 100871,China;School of Microelectronics,Shandong University,Jinan 250100,China;School of Electronic and Information Engineering,Beihang University,Beijing 100191,China;School of Astronautics,Beihang University,Beijing 100191,China)

机构地区：[1]北京大学电子学院,教育部纳米器件物理与化学重点实验室,北京100871 [2]山东大学微电子学院,济南250100 [3]北京航空航天大学电子信息工程学院,北京100191 [4]北京航空航天大学宇航学院,北京100191

出　　处：《生物化学与生物物理进展》2022年第8期1543-1554,共12页Progress In Biochemistry and Biophysics

基　　金：国家“变革性技术关键科学问题重点专项”(2017YFA0701302)资助项目。

摘　　要：目的全球视力受损或失明人数已超2亿,长期以来各类人工视觉系统被广泛研究。人工视觉系统的研发主要有两种技术路径,第一种是各类植入式人工视觉装置,第二种是各类非植入式、可穿戴装置。本文展示了一种非植入式、基于可穿戴头部触觉激发装置的系统原型,能够帮助盲人和视觉障碍者完成行走等复杂任务。方法该系统采集受试者周边环境图像信息并无线传输到后台,操作人员分析处理图像信息后,将指令以触觉编码形式无线传输到头套等可穿戴装置,由驱动电路激发多点位头部触觉,从而为受试者提供准确的行动指令。系统并辅助以语音信息,让其了解更多道路状况和环境信息。结果用原型系统对5名(2男3女)在读大学生健康志愿者和1名年轻盲症患者(男)进行实验。结果表明,原型系统充分利用了头部对前后左右的天然区分能力和对触觉的快速反应,具备直行、左右调整、转弯等明确指令功能。受试者对指令的响应时间约0.5 s,直线行走约7 m距离的偏差量标准差平均值相比未佩戴装置的情况下降低到(16±10)cm。结论该系统可隐蔽、准确地提供环境图像信息,有效帮助视觉障碍人士完成行走、避让障碍物、上台阶、进入咖啡厅等公共场所、桌上取物等日常活动,达到了预期目标。今后对原型系统作进一步完善,特别是小型化、智能芯片化,把触觉装置制成颈环、腰带、手环、脚环等,将能够广泛应用于盲人出行辅助、夜间野外旅行、深海潜水等多种工作场景。Objective More than 200 million people are visually impaired or blind worldwide.Artificial vision system has been widely studied for a long time.There are two main technical paths for the research of artificial vision system,the first is implantable artificial vision device,and the second is non-implantable and wearable device.This study demonstrates a non-implantable system prototype based on a wearable touch-vision device designed for the head that can help blind people and visually impaired people complete complex tasks in life such as walking.Methods The image information front of the subjects is collected,and transmitted wirelessly to the operator.After analyzed and processed,it is wirelessly transmitted to wearable devices such as headgears in the form of tactile coding to trigger the multi-point head tactile sensation,thus the subject’s information or precise action instructions is obtained.The system also assists the subjects with voice information,allowing them to learn more about road conditions and environmental information.Results 5 healthy volunteers(2 males and 3 females)and 1 young blind person(male)were tested with the prototype.The results show that,the prototype makes full use of the head’s natural distinguishing ability for directions including front,back,left and right,and quick response ability to the touch,and the prototype can send clear instructions such as going straight,adjusting to the left or right,and turning.The test showed that the response time of subjects to tactile commands was within 0.5 s,and the mean value of the standard deviation of the deviation of walking for about 7 m is reduced to(16±10)cm compared with the case without wearing the device.Conclusion Experimental results show that the system can provide environmental image information in a concealed and accurate manner,and help visually impaired people complete daily activities such as walking,avoiding obstacles,going up steps,entering cafes and other public places,fetching objects on the table,which meets expectatio

关 键 词：盲人 人工视觉系统 头部触觉 触觉编码 无线传输 语音辅助 

分 类 号：Q6[生物学—生物物理学] TN710[电子电信—电路与系统]