中国手语音韵标记的建立、实现及其有效性验证  

Establishment,Realization and Effectiveness Verification for Phonological Representation of Chinese Sign Language

作　　者：倪训博[1] 赵德斌[1] 姜峰[1] 程丹松[1] 

机构地区：[1]哈尔滨工业大学计算机学院,哈尔滨150001

出　　处：《计算机学报》2009年第12期2438-2453,共16页Chinese Journal of Computers

基　　金：supported by Chinese National Natural Science Foundation Key Project(60533030);Chinese National Natural Science Foundation Project(60603023)

摘　　要：手语是一门语言,手语语言学家从语言学的角度,对手语做了类似"语法"的总结而形成了音韵标注理论.针对目前中国手语无符号标记体系的现况,首先,根据中国手语的特点并结合汉语的语言习惯,文中提出了中国手语音韵标记体系.其次,针对目前音韵标注只给出一些形式化的描述或简单的手工标注的现况,文中借助基于数据手套的中国手语识别系统,提出了以手形数据模板与拉班舞谱相结合的方法,将上述的标记体系在计算机上以自动标注的方式加以实现.最后,针对数据手套的中国手语识别系统缺少先验信息的现况,应用上述音韵标记体系构建具有先验语义信息的易混词集,在构建的过程中说明并分析了音韵标记体系具备语义识别能力.实验表明,在基于统计识别的易混词集与基于先验语义信息的易混词集的识别效果相比较,在不改变统计模型的条件下,可以不同程度地辅助HMM,SOFM/HMM,Effort提高识别率.Sign language is a language. Linguists summarized grammar for sign language from the view of linguistics, and the theory of phonological representation was formed. Not having a system of sign digit in Chinese sign language, this paper firstly proposes a phonological representation according to the characteristic of Chinese sign language and language habit. Secondly, a method which combined data template of hand shape and Latin spectrum is proposed according to the characteristic of recognition system of Chinese sign language which is based on data glove, and the recognition system above is realized by the computer by means of automatic label. Finally, recognition system of Chinese sign language of data glove is lack of transcendental information, thus a confused word assemble with transcendental semantic information is established through the system of phonological representation. During the process of setting up the confused word assemble with transcendental semantic information, the semantic recognition function of the system of phonological representation is illustrated and analyzed. The confused word assemble based on statistical identification is compared with the one based on the prior sign-language semantic information. Without any change of statistic model, the experiment shows that the recognition function of phonological representation will to some extent improve the recognition rate which used the HMM,SOFM/HMM and Effort.

关 键 词：音韵标注 拉班舞谱 语义信息 易混词集 HMM SOFM/HMM EFFORT 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]