A Robust Conformer-Based Speech Recognition Model for Mandarin Air Traffic Control  

作　　者：Peiyuan Jiang Weijun Pan Jian Zhang Teng Wang Junxiang Huang 

机构地区：[1]College of Air Traffic Management,Civil Aviation Flight University of China,Deyang,618307,China [2]East China Air Traffic Management Bureau,Xiamen Air Traffic Management Station,Xiamen,361015,China

出　　处：《Computers, Materials & Continua》2023年第10期911-940,共30页计算机、材料和连续体（英文）

基　　金：This study was co-supported by the National Key R&D Program of China(No.2021YFF0603904);National Natural Science Foundation of China(U1733203);Safety Capacity Building Project of Civil Aviation Administration of China(TM2019-16-1/3).

摘　　要：This study aims to address the deviation in downstream tasks caused by inaccurate recognition results when applying Automatic Speech Recognition(ASR)technology in the Air Traffic Control(ATC)field.This paper presents a novel cascaded model architecture,namely Conformer-CTC/Attention-T5(CCAT),to build a highly accurate and robust ATC speech recognition model.To tackle the challenges posed by noise and fast speech rate in ATC,the Conformer model is employed to extract robust and discriminative speech representations from raw waveforms.On the decoding side,the Attention mechanism is integrated to facilitate precise alignment between input features and output characters.The Text-To-Text Transfer Transformer(T5)language model is also introduced to handle particular pronunciations and code-mixing issues,providing more accurate and concise textual output for downstream tasks.To enhance the model’s robustness,transfer learning and data augmentation techniques are utilized in the training strategy.The model’s performance is optimized by performing hyperparameter tunings,such as adjusting the number of attention heads,encoder layers,and the weights of the loss function.The experimental results demonstrate the significant contributions of data augmentation,hyperparameter tuning,and error correction models to the overall model performance.On the Our ATC Corpus dataset,the proposed model achieves a Character Error Rate(CER)of 3.44%,representing a 3.64%improvement compared to the baseline model.Moreover,the effectiveness of the proposed model is validated on two publicly available datasets.On the AISHELL-1 dataset,the CCAT model achieves a CER of 3.42%,showcasing a 1.23%improvement over the baseline model.Similarly,on the LibriSpeech dataset,the CCAT model achieves a Word Error Rate(WER)of 5.27%,demonstrating a performance improvement of 7.67%compared to the baseline model.Additionally,this paper proposes an evaluation criterion for assessing the robustness of ATC speech recognition systems.In robustness evaluation experim

关 键 词：Air traffic control automatic speech recognition CONFORMER robustness evaluation T5 error correction model 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]