基于BERT的电网调度语音识别语言模型研究  

Language Model for Speech Recognition of Power Grid Dispatching Based on BERT

作　　者：陈蕾 郑伟彦 余慧华 傅婧 刘宏伟 夏军强 CHEN Lei;ZHENG Weiyan;YU Huihua;FU Jing;LIU Hongwei;XIA Junqiang(State Grid Zhejiang Electric Power Co.,Ltd.,Hangzhou 310007,Zhejiang Province,China;State Grid Hangzhou Power Supply Company,Hangzhou 310020,Zhejiang Province,China)

机构地区：[1]国网浙江省电力有限公司,浙江省杭州市310007 [2]国网杭州供电公司,浙江省杭州市310020

出　　处：《电网技术》2021年第8期2955-2961,共7页Power System Technology

基　　金：国家电网公司科技项目(5400-201919144A-0-0-00)。

摘　　要：电网调度语音识别是实现智能虚拟电力调度的重要环节,其中语言模型的准确性直接关系到语音识别的效果。提出一种基于BERT的电网调度语音识别语言模型,首先介绍BERT的模型原理,以及利用BERT构建电网调度语音识别语言模型的方法;然后根据电网调度语言特点,提出对输入电网调度语音识别语言模型的调度语句进行语义特征、关键字特征和命名实体特征提取的方法,提高模型对电网调度语言的适应性;最后通过算例,对所构建的语言模型进行测试,并与其他常用的语言模型进行对比。算例结果表明,考虑了电网调度语言特点的电网调度语音识别语言模型,在语言模型的性能以及电网调度语音识别的准确性上,都有比较明显的优势。The speech recognition of power grid dispatching is an important part of intelligent virtual power dispatching,and the accuracy of the language model is directly related to the effect of speech recognition.A language model for speech recognition of power grid dispatching based on BERT is proposed.First,the principle of BERT model and the method of constructing a language model for speech recognition of power grid dispatching based on BERT are introduced.Then,according to the characteristics of power grid dispatching language,a method of extracting the semantic features,the keyword features and the named entity features from dispatching sentence input to the language model for speech recognition of power grid dispatching is proposed,which can improve the adaptability of the language model to the power grid dispatching language.Finally,the language model is tested by case studies and compared with other common language models.The results of the case studies show that the language model for speech recognition of power grid dispatching,which considers the characteristics of the power grid dispatching language,has obvious advantages in the performance of language model and the speech recognition accuracy of power grid dispatching.

关 键 词：BERT 电网调度 语音识别 语言模型 

分 类 号：TM721[电气工程—电力系统及自动化]