Affine transformation of virtual 3D object using 2D localization of fingertips  

作　　者：Mohammad Mahmudul ALAM S.M.Mahbubur RAHMAN 

机构地区：[1]Department of Electrical and Electronic Engineering,Bangladesh University of Engineering and Technology,Dhaka 1000,Bangladesh

出　　处：《Virtual Reality & Intelligent Hardware》2020年第6期534-555,共22页虚拟现实与智能硬件（中英文）

摘　　要：Background Interactions with virtual 3D objects in the virtual reality(VR)environment using the gesture of fingers captured in a wearable 2D camera have emerging applications in real-life.Method This paper presents an approach of a two-stage convolutional neural network,one for the detection of hand and another for the fingertips.One purpose of VR environments is to transform a virtual 3D object with affine parameters by using the gesture of thumb and index fingers.Results To evaluate the performance of the proposed system,one existing,and another developed egocentric fingertip databases are employed so that learning involves large variations that are common in real-life.Experimental results show that the proposed fingertip detection system outperforms the existing systems in terms of the precision of detection.Conclusion The interaction performance of the proposed system in the VR environment is higher than that of the existing systems in terms of estimation error and correlation between the ground truth and estimated affine parameters.

关 键 词：Affine transformation Detection of fingertips Detection of hand Human-computer interaction Virtual reality 

分 类 号：TP3[自动化与计算机技术—计算机科学与技术]