手势识别交互在移动端APP中的应用研究  

RESEARCH ON THE APPLICATION OF HAND TRACKING INTERACTION IN MOBILE APP

作　　者：梁爽 宣炜[1] 

机构地区：[1]江南大学设计学院

出　　处：《包装与设计》2022年第3期170-171,共2页Package & Design

摘　　要：计算机视觉技术的进步让智能设备能准确识别人类手势,从而衍生出让用户在无穿戴设备条件下直接用手势向计算机输入命令的交互方式。为探索手势识别交互应用在移动设备中的实机表现与发展前景,文章以Unity3D(优美缔)游戏引擎为开发平台,辅以增强现实与手部识别工具包,设计了一套适用于手势识别交互的操作手势,并以此开发了一个以线下超市购物为用户场景的移动端APP。通过对该APP的测试与深度体验,作者们分析了手势识别交互模式的优劣势及实用价值。Advances in computer vision technology have enabled smart devices to accurately recognize human gestures, leading to an interaction method that allows users to directly use gestures to input commands to the computer without wearing a device. Aiming to explore the real machine performance and development prospects of gesture recognition interactive applications in mobile devices, this paper takes the Unity3D game engine as the development platform and uses augmented reality and hand recognition toolkits to design a set of tools suitable for interactive gesture recognition. Based on this, the authors developed a mobile APP with offline supermarket shopping as the user scenario. Through the test and in-depth experience of the APP, the authors analyzed the advantages, disadvantages and practical value of the gesture recognition interaction mode.

关 键 词：自然手势识别 人机交互 增强现实 Unity 3D 新媒体交互设计 

分 类 号：TP3[自动化与计算机技术—计算机科学与技术]