基于多传感器数据的虚拟现实翻译机器人交互自动化系统设计  

Design of Interactive Automation System for Virtual Reality Translation Robot Based on Multi sensor Data

作　　者：莫丽娅[1] 黄铭 MO Liya;HUANGMing(Xi’an Fanyi University,Xi’an 710105,China;Xi’an Aerospace Precision Electromechanical Institute,Xi’an 710100,China)

机构地区：[1]西安翻译学院,西安710105 [2]西安航天精密机电研究所,西安710100

出　　处：《自动化与仪器仪表》2024年第3期189-192,共4页Automation & Instrumentation

基　　金：陕西省教育科学“十四五”规划2021年度课题《英语思辨阅读与课程思政融合路径研究》(SGH21Y0456);2022年陕西省社会科学基金年度项目《秦岭终南山世界地质公园语言景观的多模态译写研究》(2022K028)。

摘　　要：为进一步提升英语翻译机器人在交互过程中的翻译准确度,提出一种基于多传感器数据的虚拟现实交互自动化系统。首先,通过多种传感器采集用户的交互行为,并通过基于k最近邻算法与情景记忆的持续学习算法(简称KNN-EMAR算法)挖掘用户行为中的情感信息;再将情感信息以标签的形式融入待翻译的源语言的文本信息中,从而通过情感标签提高翻译机器人对用户表述内容的理解程度,提高英语翻译机器人翻译结果的准确度;最后利用虚拟现实技术,将用户交互行为转换为动画,并以用户交互动画+翻译语音的形式展示翻译结果。结果表明,KNN-EMAR算法可从用户交互行为中精准地挖掘出用户情感信息,且挖掘准确率可达到99.23%;情感信息的加入,使英语翻译结果的BLEU指标值和METEOR指标值得到明显提升,具有更好的英语翻译准确度;该系统可正常运行,输出用户交互动画+翻译语音的翻译结果,在跨语言教学中具有一定的实际意义。To further improve the translation accuracy of English translation robots,a virtual reality translation robot interaction automation system based on multi-sensor data is proposed.The system first utilizes Kinect sensors,IMU inertial sensors,and EMG electromyography sensors to collect information on user translation interaction behavior;Then use the KNN-EMAR algorithm for sentiment analysis to obtain the sentiment analysis results,and input the results together with the source language text information to be translated into the Universal MMT model to obtain the translation results;Finally,using virtual reality technology,create segmented animations to preserve user interaction behavior and output translation results through animation and voice.Through experiments,when the number of training samples is 700,the accuracy of KNN-EMAR in user sentiment analysis can reach 99.23%;And after adding the emotional analysis results output by the KNN-EMAR algorithm to the input information of the Universal MMT model,the BLEU and METR index values of the translation results have significantly improved,and the translation performance is good,basically meeting the design requirements;The system can operate normally and output translation results of interactive animations and translated speech in the Oculus series of virtual reality devices.Therefore,this system has certain practical significance in the research of English translation robots.

关 键 词：虚拟现实技术 动作识别 翻译理解 人机交互 英语翻译 

分 类 号：TP392[自动化与计算机技术—计算机应用技术]