汉英双语库自动分段对齐研究  

Automatic Chinese English Paragraph Segmentation and Alignment

作　　者：王斌[1] 刘群[1] 张祥[1] 

机构地区：[1]中国科学院计算技术研究所,北京100080

出　　处：《软件学报》2000年第11期1547-1553,共7页Journal of Software

基　　金：国家 8 6 3高科技项目基金资助项目!(86 3- 30 6 - 0 3- 0 6 - 2 )

摘　　要：双语库对齐是自然语言处理研究的重要课题之一 .其中 ,双语库段落对齐是指找出源文和译文中对应的翻译段落的对齐过程 .它上承篇章对齐 ,下接句子对齐 ,在整个双语库的对齐中起着承上启下的重要作用 .但由于种种原因 ,双语库段落对齐在当今研究中没有受到应有的重视 .直接进行通用的段落自动对齐具有相当的难度 ,也不必要 ,鉴于此 ,提出将段落对齐转化成分段对齐进行实现 .通过汉英词汇对之间的特征比较 ,首先找到可以用于汉英双语库分段的锚点词汇对 ,在此基础上 ,通过锚点词所在句子的匹配获得锚点句子对来进行分段 .实验结果表明 ,该方法具有良好的使用价值 。The research on bilingual corpora is one of the most important topics in the field of natural language processing. Paragraph alignment is to find the translation paragraph pairs between source text and target text. Paragraph alignment is a necessary and important phase between section alignment and sentence alignment, but it is disregarded at present. This paper aims at dealing with this process. Because it is difficult and unnecessary to align paragraphs directly, this problem is changed into a “segmentation and alignment” one. This paper finds some anchors for segmentation first, and then matches the sentences which contain these anchors, finally checks the validity of the results and segments the texts into translation blocks. The experimental results show that the method can achieve good results and can also be applied to other language pairs.

关 键 词：自然语言处理 汉英双语库 自动对齐 自动分段 

分 类 号：TP391.12[自动化与计算机技术—计算机应用技术]