基于组块分割的无监督藏文句法分析方法研究  

Research on Unsupervised Tibetan Syntax Analysis with Chunk Segmentation

作　　者：卓玛扎西 才让加[1,2,3] 色差甲 班玛宝 ZHUO Ma-zha-xi;CAI Rang-jia;SE Cha-jia;BAN Ma-bao(College of Computer Science and Technology,Qinghai Normal University,Xining Qinghai 810016,China;The State Key Laboratory of Tibetan Intelligent Information Processing and Application,Xining Qinghai 810008,China;Tibetan Information Processing Engineering Technology and Research Center of Qinghai Province,Xining Qinghai 810008,China)

机构地区：[1]青海师范大学计算机学院,青海西宁810016 [2]藏语智能信息处理及应用国家重点实验室,青海西宁810008 [3]青海省藏文信息处理工程技术研究中心,青海西宁810008

出　　处：《计算机仿真》2022年第5期278-282,328,共6页Computer Simulation

基　　金：国家自然科学基金资助项目(61662061,61063033);青海省藏文信息处理与机器翻译重点实验室(2020-ZJ-Y05)。

摘　　要：由于藏文句法树库的构建在藏语自然语言处理中是一项专业性强及费时费力的工作,目前还没有公开的藏文句法树库,这一现状导致有监督方法在藏文句法分析任务中的运用存在较大困难。鉴于此,提出了一种基于组块分割的无监督藏文句法分析方法,首先对藏文组块进行了定义和分割,然后在此基础上提出无监督藏文句法分析方法并设计了藏文句法优化算法。提出的方法在不同句子长度和不同领域分布的各类测试集上都取得了显著效果,优于基准方法的结果,证实了提出的方法在缺少标记数据的设定下的有效性。The construction of Tibetan syntax treebank is a laborious task that requires dense expertise.Since there is no public well-labeled dataset of Tibetan syntax treebank,supervised proposal in Tibetan syntax analysis is barely a promising option.To this end,in this work,we proposed an unsupervised Tibetan syntax analysis based on chunk segmentation techniques.We firstly introduced the definition of syntactic chunk for Tibetan and apply chunk-segmentation operations,then proposed an unsupervised Tibetan syntax analysis techniques and algorithm for optimizing Tibetan syntax.The proposed method was evaluated on test datasets with different sentence length and domain distributions and produces promising results,over-passing all other baselines.The results indicate the effectiveness of unsupervised syntax analysis method based on chunk segmentation in the task of Tibetan syntax analysis under settings where labeled data is not available.

关 键 词：自然语言处理 组块分割 无监督 藏文句法分析 

分 类 号：TP391.9[自动化与计算机技术—计算机应用技术]