Use of multimodal physiological signals to explore pilots’cognitive behaviour during flight strike task performance  

作　　者：Xiashuang Wang Guanghong Gong Ni Li Li Ding 

机构地区：[1]State Key Laboratory of Virtual Reality Technology and Systems,Beihang University,Beijing,100083,China [2]Automation Science and Electrical Engineering,Beihang University,Beijing,100083,China [3]Biomedical Engineering College,Beihang University,Beijing,100083,China [4]Beijing Advanced Innovation Center for Biomedical Engineering,Beihang University,Beijing,100083,China

出　　处：《Medicine in Novel Technology and Devices》2020年第1期21-26,共6页医学中新技术与新装备（英文）

摘　　要：This study explored the use of multi-physiological signals and simultaneously recorded high-density electroencephalography(EEG),electrocardiogram(ECG),and eye movements to better understand pilots’cognitive behaviour during flight simulator manoeuvres.Multimodal physiological signals were collected from 12 experienced pilots with international aviation qualifications under the wide-angle and impressive vision simulation.The data collection spanned two flight strike missions,each with three mission intensities,resulting in a data set of EEG,ECG,and eye movement signals from six subtasks.The multimodal data were analysed using signal processing methods.The results indicated that,when the flight missions were performed,the pilots’physiological characteristics exhibited rhythmic changes in the power spectrum ofθwaves in the EEG,r-MSSD in the ECG,and average gaze duration.Furthermore,the pilots’physiological signals were more sensitive during the target mission than during the empty target mission.The results also showed correlations between different physiological characteristics.We showed that specific multimodal features are useful for advancing neuroscience research into pilots’cognitive behaviour and processes related to brain activity,psychological rhythms,and eye movement.

关 键 词：Multimodal physiological signals Pilot cognition behaviour Visual stimulation Aircraft simulator Electroencephalography(EEG) Electrocardiography(ECG) Electro-oculogram(EOG) Areas of interest(AOI) Virtual reality(VR) 

分 类 号：R74[医药卫生—神经病学与精神病学]