基于阅读技巧识别和双通道融合机制的机器阅读理解方法  

A Machine Reading Comprehension Approach Based on Reading Skill Recognition and Dual Channel Fusion Mechanism

在线阅读下载全文

作  者:彭伟 胡玥[1,3] 李运鹏 谢玉强 牛晨旭 PENG Wei;HU Yue;LI Yun-Peng;XIE Yu-Qiang;NIU Chen-Xu(Institute of Information Engineering,Chinese Academy of Sciences,Beijing 100085;Zhongguancun Laboratory,Beijing 100080;School of Cyber Security,University of Chinese Academy of Sciences,Beijing 100085)

机构地区:[1]中国科学院信息工程研究所,北京100085 [2]中关村实验室,北京100080 [3]中国科学院大学网络空间安全学院,北京100085

出  处:《自动化学报》2024年第5期958-969,共12页Acta Automatica Sinica

基  金:国家自然科学基金(62006222,U21B2009);中国科学院战略性先导研究计划(XDC02030400)资助。

摘  要:机器阅读理解任务旨在要求系统对给定文章进行理解,然后对给定问题进行回答.先前的工作重点聚焦在问题和文章间的交互信息,忽略了对问题进行更加细粒度的分析(如问题所考察的阅读技巧是什么?).受先前研究的启发,人类对于问题的理解是一个多维度的过程.首先,人类需要理解问题的上下文信息;然后,针对不同类型问题,识别其需要使用的阅读技巧;最后,通过与文章交互回答出问题答案.针对这些问题,提出一种基于阅读技巧识别和双通道融合的机器阅读理解方法,对问题进行更加细致的分析,从而提高模型回答问题的准确性.阅读技巧识别器通过对比学习的方法,能够显式地捕获阅读技巧的语义信息.双通道融合机制将问题与文章的交互信息和阅读技巧的语义信息进行深层次的融合,从而达到辅助系统理解问题和文章的目的.为了验证该模型的效果,在FairytaleQA数据集上进行实验,实验结果表明,该方法实现了在机器阅读理解任务和阅读技巧识别任务上的最好效果.Machine reading comprehension task aims to require the system to understand a given passage and then answer a question.Previous researches focus on the interaction between questions and passages.However,they neglect to make a more granular analysis of the questions,e.g.,what is the reading skill examined by the questions?Inspired by the previous reading comprehension literature,the understanding of questions is a multi-dimensional process where humans first need to understand the context semantics of the question,then identify the reading skills they need to use for different types of questions,and finally answer the question.In the end,we propose a machine reading comprehension method based on reading skill recognition and dual channel fusion mechanism to make a comprehensive analysis of questions,so as to improve the accuracy of the model in answering questions.Specifically,the reading skill recognizer can capture the semantic representations of reading skills through contrastive learning.The dual channel fusion mechanism deeply integrates the contextual information and the semantic representations of reading skills,so as to help the system understand the question and passage.To verify the effectivenesss of the model,we conduct experiments on the FairytaleQA dataset.The experimental results show that the proposed method achieves the state-of-the-art performance on machine reading comprehension task and reading skill recognition task.

关 键 词:机器阅读理解 阅读技巧识别 对比学习 双通道融合机制 

分 类 号:TP391.1[自动化与计算机技术—计算机应用技术]

 

参考文献:

正在载入数据...

 

二级参考文献:

正在载入数据...

 

耦合文献:

正在载入数据...

 

引证文献:

正在载入数据...

 

二级引证文献:

正在载入数据...

 

同被引文献:

正在载入数据...

 

相关期刊文献:

正在载入数据...

相关的主题
相关的作者对象
相关的机构对象