飞行员使用平视显示器的行为模式识别  

Behavior Pattern Recognition for Pilots Using Head up Display

作　　者：杨坤 王浩然[2,3] YANG Kun;WANG Hao-ran(School of Airworthiness Civil Aviation University of China,Tianjin 300300,China;Key Laboratory of Civil Aircraft Airworthiness and Maintenance Civil Aviation University of China,Tianjin 300300,China;School of Aeronautic Engineering,Civil Aviation University of China,Tianjin 300300,China)

机构地区：[1]中国民航大学适航学院,天津300300 [2]中国民航大学民用航空器适航与维修重点实验室,天津300300 [3]中国民航大学航空工程学院,天津300300

出　　处：《科学技术与工程》2018年第29期226-231,共6页Science Technology and Engineering

摘　　要：为了研究飞行员在使用平视显示器(head up display,HUD)执行不同飞行任务时的行为模式,提出了一种包括飞行员眼动、头部运动和手部运动多种特征的行为识别框架。首先,开展行为模式研究实验,通过眼动仪获取眼部运动和头部运动,通过基于视频的手动跟踪获取手部运动。之后采用实验得到的结果对模型进行训练和测试。最后,对比了条件随机场和隐动态条件随机场在不同特征下的识别效果。结果表明,采用眼动特征加手部特征时,隐动态条件随机场模型对不同飞行任务的识别效果较好。In order to study the behavior patterns of pilots using(head up display,HUD)in different stages of the flight,a behavior recognition framework including pilots eye movements,head movements and hand movements are proposed.Firstly,get eye movement data and head position data through the Smart-Eye,hand movement data was got by hand tracking based on video.Secondly,experiment and using the experimental results to train and test the model are designed.Finally,the recognition effect of the different characteristics of the pilot was compared in different stages of the flight between CRF and LDCRF.Experimental results show that the recognition effect pilot eye movement and head position,using LDCRF,is good.

关 键 词：飞行员 平视显示器 手势跟踪 眼动跟踪 隐动态条件随机场 模式识别 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]