基于长度的扩展方法的汉英句子对齐  

Aligning Sentences in Chinese-English Corpora with Extended Length-based Approach

作　　者：张艳 柏冈秀纪 

机构地区：[1]国际电气通信技术研究所音声言语通信研究所

出　　处：《中文信息学报》2005年第5期31-36,58,共7页Journal of Chinese Information Processing

基　　金：日本情报通信研究机构的委托研究项目

摘　　要：本文提出了一种用于汉英平行语料库对齐的扩展方法。该扩展方法以基于长度的统计对齐方法为主,然后根据双语词典引入了词汇信息,而基于标点的方法作为对齐的后处理部分。这种扩展方法不仅避免了复杂的中文处理,例如,汉语分词和词性标注,而且在统计方法中引入了关键词信息,以提高句子对齐的正确率。本文中所用的双语语料是LDC的关于香港的双语新闻报道。动态规划算法用于系统的实现。和单纯的基于长度的方法和词汇方法相比,我们的扩展方法提高了句子对齐的正确率,并且结果是比较理想的。In this paper, we present a new approach to align Chinese-English sentences in the parallel texts. This approach Ks mainly based on statistical approach, here is length-based alignment approach, and simultaneously considers lexical informarion from the bilingual lexicon. Punctoation-based approach is the post-processing for alignment. This extended approach not only avoids complicated Chinese processing further, such as segmentation and part-of-speech tagging, but also uses some Chinese key words in the statistical approach to improve accuracy of sentence alignment. The bilingual corpus in this paper is LDC parallel texts in Hong Kong newspaper. Then dynamic programming algorithm is used to accomplish the alignment processing. Compared with length-based approach and lexical approach, our approach improves the alignment accuracy and the experiment result is desirable.

关 键 词：人工智能 机器翻译 句子对齐 中文处理 双语语料库 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]