基于触屏设备的人机交互界面设计  

The Design of Human-robot Interface Based on Touch-screen Device

作　　者：刘佰鑫[1] 刘成良[1] 贡亮[1] 

机构地区：[1]上海交通大学机械与动力工程学院,上海200240

出　　处：《机电一体化》2015年第4期45-47,72,共4页Mechatronics

基　　金：科技部863计划课题(编号2013AA102307)

摘　　要：针对语音和手势等自然的控制方式易产生信息歧义和编解码复杂的情况,提出基于触摸操作的人机协作方法,以较为自然的方式实现人机交互。以触屏设备、无线网络和双目摄像机为硬件基础,在Android框架内实现人机远程交互界面。将双目摄像机获取的景深图像通过无线网络通信显示在触屏移动设备上,由用户在二维界面上触摸给出目标的三维坐标,驱动机器人作业。实验证明该界面支持用户如玩游戏般控制机器人完成预设任务。界面用自然的方式提高人机交互的准确率和可用性,达到预期效果。For the situation that ambiguity and complex codec of voice or gesture interaction with robot, we pro- posed interaction method make use of touch-screen device, wireless network and binocular camera to build a remote human-robot interface in the Android framework. A human-robot interaction method based on the touch operation has been introduced, the depth image of robot＇s field view captured by binocular camera transmits to the touch-screen de- vice through a wireless local area network, thus while an user touch on the target which displaying on the two-dimen- sional screen, the three-dimensional coordinate of target is given to drive robot operation. Finally, an experimental was made and the result shows that the interface has the capacity to control the robot to complete scheduled tasks just like playing games. The proposed interaction method and interface improve the accuracy and availability of human in- teraction with robot in the natural way.

关 键 词：人机界面 触屏 景深图像 

分 类 号：TN873[电子电信—信息与通信工程]