交互式手工搬运作业仿真系统的设计与开发  

Design and development of interactive manual material handling simulation system

作　　者：樊树海[1,2] 张倩 周策 陶嘉庆 杨秋宇 FAN Shuhai;ZHANG Qian;ZHOU Ce;TAO Jiaqing;YANG Qiuyu(Department of Industrial Engineering,Nanjing Tech University,Nanjing 210009,China;Information Quality Program“Data Quality and Information Security”Laboratory,Massachusetts Institute of Technology,Massachusetts 02139,USA)

机构地区：[1]南京工业大学工业工程系,江苏南京210009 [2]麻省理工学院信息质量项目“数据质量与信息安全”实验室,美国马萨诸塞州02139

出　　处：《现代电子技术》2022年第6期49-52,共4页Modern Electronics Technique

基　　金：国家自然科学基金项目(71671089);国家自然科学基金项目(71171110)。

摘　　要：针对虚拟仿真实验平台中设备接口不一致导致在线控制与实时交互难的问题,文中设计一种基于运动捕捉设备Kinect的交互式手工搬运作业虚拟仿真实验系统。该系统由3D体感摄像机Kinect、Windows for SDK开发套件和人机工效仿真软件JACK组成。首先按照规范搭建虚拟手工搬运的实验环境,利用Kinect捕捉人体运动骨骼数据,根据逆运动学知识进行骨骼数据重定;再通过JACK中定制化Kinect模块接口,实现Kinect⁃JACK的实时交互,从而在线控制虚拟人运动并成功运用于手工搬运作业中。结果表明,文中设计的虚拟仿真实验系统充分融合了人机工程学知识与虚拟仿真技术,利用半实物仿真原理拓展了虚拟仿真实验平台的应用范围,为学生提供了良好的交互式体验,提高了实验教学质量。In allusion to the problem that the inconsistent equipment interface in the virtual simulation experiment platform leads to the difficulty of on⁃line control and real⁃time interaction,an interactive manual material handling virtual simulation experiment system based on motion capture device Kinect is designed.The system is composed of 3D somatosensory camera Kinect,Windows for SDK development kit and ergonomic simulation software JACK.The experimental environment of virtual manual material handling is built according to the specification,the human motion bone data is captured by means of the Kinect,and the bone data is reset according to the inverse kinematics knowledge.The Kinect⁃JACK real⁃time interaction is realized by means of the customized Kinect module interface in JACK,so as to control the movement of virtual human online and successfully apply it into the manual material handling.The results show that the virtual simulation experiment system designed in this paper can fully integrate ergonomics knowledge and virtual simulation technology,expand the application scope of the virtual simulation experiment platform by means of the principle of hardware in the loop simulation,provide good interactive experience for students,and improve the quality of experimental teaching.

关 键 词：交互式仿真平台 实时交互 实验教学 虚拟仿真 虚拟技术 系统设计 手工搬运 JACK KINECT 

分 类 号：TN911-34[电子电信—通信与信息系统] G642.423[电子电信—信息与通信工程]