基于RoBERTa-BiGRU-CRF的交通事故处置流程文本信息抽取  

Text Information Extraction of Traffic Accident Disposal Process Based on RoBERTa-BiGRU-CRF

作　　者：陈娇娜 张静[1] 靳引利[2] 王鹏[1] CHEN Jiaona;ZHANG Jing;JIN Yinli;WANG Peng(School of Electronic Engineering,Xi'an Shiyou University,Xi'an 710065,China;School of Electronics and Control Engineering,Chang'an University,Xi'an 710061,China)

机构地区：[1]西安石油大学电子工程学院,陕西西安710065 [2]长安大学电子与控制工程学院,陕西西安710061

出　　处：《交通运输研究》2024年第3期20-28,共9页Transport Research

基　　金：国家自然青年科学基金项目(52002315);国家重点研发计划项目(2019YFB1600700)。

摘　　要：为改善现有交通事故应急信息识别中处置流程抽取不足的问题,以提高应急处置知识抽取的准确率,针对交通事故文本信息自然语言描述的复杂性,提出了一种基于预训练模型和混合深度学习网络的交通事故处置流程抽取方法。首先,从事故属性、处置机构、处置措施、处置效果和任务预判5个方面定义交通事故处置流程实体,并采用BIO标注实体类型。然后,将RoBERTa预训练模型生成的词向量作为输入,采用BiGRU模型进行特征提取,通过CRF模型进行条件约束来获得最终实体类型,并对RoBERTa-BiGRU-CRF组合模型的交通事故处置流程抽取结果进行时序融合,利用图数据库对抽取结果进行知识存储和可视化展示。最后,以陕西省高速公路交通事故文本信息为样本数据集,分别比较了不同预训练模型和深度学习网络的模型性能,利用消融实验论证了RoBERTa-BiGRU-CRF模型的有效性,并通过某起交通事故进行了实例验证。结果显示,RoBERTa-BiGRU-CRF组合模型的抽取效果最佳,F1值为99.77%。研究表明,所提方法能有效从文本信息中抽取交通事故应急处置流程关键要素,实现了应急处置流程抽取结果的可视化呈现,可为应急处置决策提供参考。To address the existing issue of insufficient extraction in recognizing traffic accident emergency information and improve the accuracy of emergency processing knowledge extraction,a method for extracting the traffic accident process based on pre-training model and hybrid deep learning networks was proposed aiming at the complexity of natural language description of traffic accident text information.Firstly,the disposal process entities of traffic accidents were defined from five aspects such as accident characteristic,disposal agency,disposal measures,disposal effects,and task prediction,and these entity types were marked using BIO notation.Then,the word vectors generated by the RoBERTa pretrained model were used as input,the BiGRU model was used for feature extraction,and the CRF model was used for conditional constraints to obtain the final entity type.Furthermore,time-series fusion was used to the traffic accident handling process extraction results obtained from RoBERTa-BiGRU-CRF combined model,and the extracted results were stored and visualized using a graph database.Finally,using the text information of highway traffic accidents in Shaanxi Province as a sample data set,the performance of different pre-trained models and deep learning networks were compared,the effectiveness of the RoBERTa-BiGRU-CRF model was demonstrated through ablation experiments and validated through an example of one traffic accident.The results demonstrated that the Ro-BERTa-BiGRU-CRF combined model yielded superior extraction results with the F1 value of 99.77%.Research has shown that the proposed method can effectively extract key elements of the emergency response process for traffic accidents from textual information,achieve visual presentation of the results of emergency response process extraction,and provide reference for emergency response decision-making.

关 键 词：交通安全 交通事故 实体抽取 预训练模型 深度学习 时序融合 

分 类 号：U495[交通运输工程—交通运输规划与管理]