自然语言语义库构建方法研究  

Research on the Construction Method of Natural Language Semantic Corpus

作　　者：杨菊英[1] 江兵 罗佳[1] YANG Juying;JIANG Bing;LUO Jia(Department of Computer Science,Chengdu College of University of Electronic Science and Technology of China,Chengdu 611731,China;Business School,Sichuan Agricultural University,Dujiangyan 611830,China)

机构地区：[1]电子科技大学成都学院计算机系,成都611731 [2]四川农业大学商学院,四川都江堰611830

出　　处：《重庆理工大学学报（自然科学）》2019年第10期103-108,共6页Journal of Chongqing University of Technology：Natural Science

基　　金：四川省科技厅项目“基于Linux的高性能集群设计”(172102210594)

摘　　要：自然语言语义语料库构建是智能云计算环境中实现信息交换的关键步骤,对语义语料库构造技术进行了分析,提出了一种基于词频-逆文本频率(term frequency-inverse document frequency,TF-IDF)和字向量距离的新型网页去重复算法,该方法专注于解决语音识别中的存储问题,为分词和句法分析提供功能支持。该方法可以直接用于语义语料库构建,能提高网页重复数据删除的效率。实验结果表明:该方法能实现云计算平台的语义库构建,且性能优于其他方法,说明了该方法的可行性和有效性。Natural language semantic corpus construction is a key step to realize information exchange in Intelligent Cloud Computing environment.This paper analyzes the construction technology of semantic corpus in detail and proposes a new web page reconstruction method based on term frequency-inverse document frequency(TF-IDF)and word vector distance.The algorithm focuses on the storage problem in speech recognition.It provides functional support for word segmentation and syntactic analysis.This method can be directly used in the construction of semantic corpus,and can improve the efficiency of deleting duplicate data from web pages.The experimental results show that this method can realize the semantic library construction of cloud computing platform,and the performance is better than other methods,indicating the feasibility and effectiveness of this method.

关 键 词：自然语言 语义库 词频-逆文本频率 字向量距离 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]