基于CYK的藏语句法分析器研究与实现  

Research and implementation of Tibetan sentence analyzer of CYK algorithm

作　　者：尕藏扎西 安见才让[1] Gazang Zhaxi;Anjian Cairang(school of computing,Qinghai University for Nationalities,Xining,Qinghai 810007,China)

机构地区：[1]青海民族大学计算机学院,青海西宁810007

出　　处：《计算机时代》2018年第6期53-56,共4页Computer Era

摘　　要：句法分析是自然语言处理中一个很复杂的研究内容。藏语句法分析更是目前藏文信息处理中的一个基本问题,许多藏文信息处理任务都依赖着句法分析的精确度。文章根据常用的藏文短语,总结出一套基于短语结构语法的藏文单句规则库,然后在Windows平台上用C#实现基于CYK算法来分析和生成句法树的藏语句法分析器。实验结果表明,在人工标注的测试集上,藏语单句的句法分析准确率达到了81%。Syntactic analysis is a very complex research content in natural language processing. The Tibetan sentence analysis is a basic problem in Tibetan information processing. Many Tibetan information processing tasks rely on the accuracy of syntactic analysis. According to the commonly used Tibetan phrases, this paper summarizes a set of Tibetan single sentence rule bases based on the phrase structure grammar. Then C# is used to implement the Tibetan sentence analyzer which uses CYK algorithm to parse and generate syntactic tree, on Windows platform. The experimental results show that the accuracy of the syntactic analysis of a single sentence in Tibetan reaches 81% on the manually labeled test set.

关 键 词：规则库 CYK算法 乔姆斯基范式 句法树 句法分析 

分 类 号：TP39[自动化与计算机技术—计算机应用技术]