基于眼动信号的便携式无线智能交互系统设计  

Design of Portable Wireless Intelligent Interactive System Based on Eye Movement Signal

作　　者：郜东瑞 汪润桂[2] 应少飞 姜东 陈家鑫 宗欣 董丽娟 宋晓宇[2] 王录涛 Gao Dongrui;Wang Rungui;Ying Shaofei;Jiang Dong;Chen Jiaxin;Zong Xin;Dong Lijuan;Song Xiaoyu;Wang Lutao(School of Computer Science,Chengdu University of Information Technology,Chengdu 610225,China;Center for Information in Medicine,University of Electronic Science and Technology of China,Chengdu 610054,China)

机构地区：[1]成都信息工程大学计算机学院,成都610225 [2]电子科技大学信息医学中心,成都610054

出　　处：《中国生物医学工程学报》2019年第5期573-580,共8页Chinese Journal of Biomedical Engineering

基　　金：四川省教育厅项目(18ZB0115);成都信息工程大学引进人才科研启动项目(KYTZ201720)

摘　　要：肢体运动障碍患者由于无法控制四肢操控现代化的电子设备(如手机、平板等)与外界交流,因此很难融入信息化的社会。设计一个基于眼动信号的便携式无线智能交互系统,帮助使用者利用自身眼动信号控制电子设备,实现与外界的沟通。该系统包含模拟电路和数字电路两部分,模拟电路实现眼动信号的滤波、放大等处理,数字电路将模拟信号转换为数字信号,并实现对信号的实时分析处理,主要包括采用基于短时能量的端点获得信号活动段的起止位置,并将位置、幅值、波峰数等作为信号特征选择量,然后采用过零点分析和动态阈值方法识别不同类型的眼动信号,利用状态机定义不同类型的眼部信号与电子设备中鼠标动作的对应关系。选择15名使用者进行试验测试,要求被试根据随机指令控制眼部实现5个不同动作,包括眼球向上看、向下看、向左看、向右看、主动眨眼,每个动作共执行100次。测试结果表明,每个眼部动作平均识别准确率大于94%,最低平均信息传输率大于22 bits/min,因此能够利用眼动信号代替鼠标实现对电子设备的控制,实现字符输入、拨打电话、听音乐以及浏览网页等功能。Patients with motor impairment are unable to control modern electronic devices(mobile phones,iPAD,etc.)to communicate with the outside world.It is difficult for them to integrate into information-based society.In this paper,a portable wireless intelligent interactive system was designed to help users control electronic devices with their own eye movement signals to help them communicate with the outside world.The system was made up of analog and digital circuits.The analog circuit was used for filtering and amplification.The digital circuit was used to convert analog signals to digital signals,and then the digital signals were analyzed and processed in real time.It included using short-term energy endpoints to obtain starting and ending positions of signal activity segments,selecting location,amplitude,and wave peak number as signal characteristics,and then using zero-crossing analysis and dynamic threshold method to identify different types of eye movement signals.At last a state machine was used to define the corresponding relationship between different types of eye signals and mouse movements in the electronic devices.Fifteen subjects were enrolled for the test,they were required to control five different eye movements according to random instructions,including looking up,down,left,right and active blinking,and each action was performed 100 times in total.Results showed that the average accuracy of each eye movement was more than 94%,and the minimum average information transfer rate was more than 22 bits/min.In conclusion,this system could use the eye movement to replace the mouse to control electronic devices,realizing functions of character input,making phone calls,listening to music,and browsing the web.

关 键 词：眼动信号 智能交互系统 便携式 

分 类 号：R318[医药卫生—生物医学工程]