面向时钟领域的BERT-LCRF命名实体识别方法  

BERT-LCRF Named Entity Recognition Method Oriented Clock Domain

作　　者：唐焕玲[1,3,4] 王慧 隗昊 赵红磊 窦全胜 鲁明羽[5] TANG Huanling;WANG Hui;WEI Hao;ZHAO Honglei;DOU Quansheng;LU Mingyu(School ofComputer Science andTechnology,ShandongTechnology andBusinessUniversity,Yantai,Shandong 264005,China;School of Information and Electronic Engineering,Shandong Technology and Business University,Yantai,Shandong 264005,China;Co-innovation Center of Shandong Colleges and Universities:Future Intelligent Computing,Yantai,Shandong 264005,China;Key Laboratory of Intelligent Information Processing in Universities of Shandong(Shandong Technology and Business University),Yantai,Shandong 264005,China;Information Science and Technology College,Dalian Maritime University,Dalian,Liaoning 116026,China)

机构地区：[1]山东工商学院计算机科学与技术学院,山东烟台264005 [2]山东工商学院信息与电子工程学院,山东烟台264005 [3]山东省高等学校协同创新中心:未来智能计算,山东烟台264005 [4]山东省高校智能信息处理重点实验室(山东工商学院),山东烟台264005 [5]大连海事大学信息科学技术学院,辽宁大连116026

出　　处：《计算机工程与应用》2022年第18期218-226,共9页Computer Engineering and Applications

基　　金：国家自然科学基金(61976124,61976125,61773244,61772319)。

摘　　要：命名实体识别是构建时钟领域知识图谱的关键步骤,然而目前时钟领域存在标注样本数量少等问题,导致面向时钟领域的命名实体识别精度不高。为此,利用预训练语言模型BERT进行时钟领域文本的特征提取,利用线性链条件随机场(Linear-CRF)方法进行序列标注,提出了一种BERT-LCRF的命名实体识别模型。对比实验结果表明,该模型能够充分学习时钟领域的特征信息,提升序列标注精度,进而提升时钟领域的命名实体识别效果。Named entity recognition is a key step in constructing a knowledge graph in the clock domain. However, the current clock domain has problems such as the small number of labeled samples, which leads to the low accuracy of named entity recognition in the clock domain. To this end, this paper uses the pre-trained language model BERT to extract the features of the text in the clock domain, and then uses the linear chain conditional random field(Linear-CRF)method for sequence labeling, and proposes a BERT-LCRF named entity recognition model. The results of comparative experiments show that the model can fully learn the feature information of the clock domain, improve the accuracy of sequence labeling, and then improve the effect of named entity recognition in the clock domain.

关 键 词：命名实体识别 预训练语言模型 条件随机场 自注意力机制 深度学习 

分 类 号：TP181[自动化与计算机技术—控制理论与控制工程]