一种3D眼镜虚拟试戴系统的实现  

Realization of A Virtual Try-on System for 3D Glasses

作　　者：王晓锋 付东翔[1] WANG Xiaofeng;FU Dongxiang(School of Optical-Electrical and Computer Engineering,University of Shanghai for Science and Technology,Shanghai 200093,China)

机构地区：[1]上海理工大学光电信息与计算机工程学院,上海200093

出　　处：《电子科技》2023年第1期44-50,共7页Electronic Science and Technology

基　　金：国家自然科学基金(61605114;61703277)。

摘　　要：针对人脸图像试戴3D眼镜过程中存在的镜腿遮挡人脸问题,文中提出一种基于人脸图像的3D眼镜虚拟试戴技术。利用构建的人脸形状的三维模型,使其在虚拟试戴中对镜腿起到消隐作用,解决镜腿的遮挡问题。文中对输入的人脸图像进行关键点检测,结合Graham扫描法求得人脸形状的凸多边形,利用平移扫描构建人脸形状的三维模型。此外,文中根据定位人脸图像上的关键点以及姿态估计后对三维眼镜模型的变换,将眼镜模型佩戴到人脸图像上。实验结果表明,该方法对于多视角的人脸图像实现了虚拟试戴效果,解决了多种视角下人脸图像试戴过程中镜腿的遮挡问题,虚拟试戴中镜腿遮挡平均准确率为94.5%,遮挡精度较高。In order to solve the problem that the mirror legs shade the face in the process of trying on 3D glasses on face image,this study proposes a virtual trying on system of 3D glasses based on face image.The three-dimensional model of the face shape is used to blank the mirror leg and solve the occlusion problem of the mirror leg.The key points of the input face image are detected,and the convex hull of the face shape is obtained by combining the Graham scanning method,and the three-dimensional model of the face shape is constructed by the translation scanning method.Additionally,according to the positioning of key points on the face image and the transformation of the 3D glasses model after pose estimation,the glasses model is worn on the face image.The experimental results show that the method achieves virtual try-on effect for multi-view face images,and solves the problem of occlusion of temples in the process of face images from multiple viewing angles.The average occlusion accuracy of the blanking leg during virtual trial is 94.5%,and the occlusion accuracy is high.

关 键 词：虚拟试戴 遮挡问题 多视角试戴 凸包算法 Graham扫描法 关键点检测 姿态估计 平移扫描 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]