基于Leap Motion手语语音转换的设计与实现  

Design and implementation of voice conversion based on Leap Motion sign language

作　　者：姜檬 郭仁春[1] 李俊龙 王志淳 Jiang Meng;Guo Renchun;Li Junlong;Wang Zhichun(Shenyang University of Chemical Technology,Shenyang 110142,China)

机构地区：[1]沈阳化工大学,辽宁沈阳110142

出　　处：《无线互联科技》2020年第7期67-70,共4页Wireless Internet Technology

基　　金：2019年辽宁省大学生创新创业训练计划资助项目,项目编号:201910149053。

摘　　要：文章介绍了基于Leap Motion手语语音转换的原理以及在实际中如何实现应用,其能够将手语手势翻译成所需语言,并且以语音的形式传递消息,实现为聋哑人"发声"的目的。Leap Motion手语语音转换的硬件部分采用Leap Motion体感控制器,能够实时采集人手指的坐标、加速度、方向等动态手势的运动信息。软件采用Unity 3D三维引擎,提供了开发手势识别的SDK,并给出了一些基本手的模型,在Unity 3D中完成由手势到文字,再到语音的转换。This paper introduces the principle of sign-language conversion based on Leap Motion and how to implement it in practice. It can translate gestures into the required language and transmit messages in the form of speech, so as to achieve the purpose of "voice" for deaf-mute people. The hardware part of sign-language speech conversion based on Leap Motion uses motion-sensing controller called Leap Motion, which can collect the motion information of the finger’s coordinate, acceleration, direction and other dynamic gestures in real time. The software uses Unity 3D engine, provides an SDK for developing gesture recognition, as well as some basic hand models for converting gestures to text and then to speech in Unity 3D.

关 键 词：动态手势识别 厉动 UNITY 3D 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术] TN912.3[自动化与计算机技术—计算机科学与技术]