基于手语表达内容与表达特征的手语识别技术综述  

A Survey of Sign Language Recognition Technology Based on Sign Language Expression Content and Expression Characteristics

作　　者：陶唐飞 刘天宇[2] TAO Tangfei;LIU Tianyu(Key Laboratory of Education Ministry for Modern Design&Rotor-Bearing System,Xi’an 710049,China;School of Mechanical Engineering,Xi’an Jiaotong University,Xi’an 710049,China)

机构地区：[1]现代设计及转子轴承系统教育部重点实验室,西安710049 [2]西安交通大学机械工程学院,西安710049

出　　处：《电子与信息学报》2023年第10期3439-3457,共19页Journal of Electronics & Information Technology

基　　金：陕西省重点研发计划(2020KWZ-003)。

摘　　要：手语识别(SLR)技术是打破听障人群与健听人群间交流壁垒的重要技术手段。该文综述了近几年的手语数据集、评价指标以及手语识别方法。首先,系统梳理了手语数据集并分析了手语识别方法的数据集发展方向。其次,详细介绍了手语识别方法的评价指标。然后,根据手语表达内容、手语识别方法所采用的特征分类总结分析了孤立词手语识别方法与连续语句识别方法、仅依靠手部特征的手语识别方法与多特征融合的手语识别方法。最后探讨了手语识别技术面临的挑战及其发展方向。Sign Language Recognition(SLR)technology is an important technical means to break the communication barrier between hearing-impaired people and healthy people.The sign language datasets,evaluation indicators and sign language recognition methods in recent years are summarized.Firstly,the sign language dataset is systematically summarized and the development trend of the dataset of sign language recognition methods is analyzed.Secondly,the evaluation indicator of sign language recognition method is introduced in detail.Then,according to the content of sign language expression and the features used in sign language recognition methods,isolated word sign language recognition methods and continuous sign language recognition methods,sign language recognition methods relying only on hand features and sign language recognition methods of multi feature fusion are summarized and analyzed.Finally,the challenges and development direction of sign language recognition technology are discussed.

关 键 词：手语识别技术 手语数据集 孤立词手语识别 连续手语识别 多特征融合手语识别 

分 类 号：TP3-05[自动化与计算机技术—计算机科学与技术]