基于Kinect的实时深度提取与多视绘制算法  

Real-time depth extraction and multi-view rendering algorithm based on Kinect

作　　者：王奎[1] 安平[1] 张艳[1] 程浩[1] 张兆扬[1] 

机构地区：[1]上海大学通信与信息工程学院新型显示技术及应用集成教育部重点实验室,上海200072

出　　处：《光电子．激光》2012年第10期1949-1956,共8页Journal of Optoelectronics·Laser

基　　金：国家自然科学基金(60832003;61172096;61171084);上海市科委重点(10510500500)资助项目

摘　　要：提出了一种基于Kinect的实时深度提取算法和单纹理+深度的多视绘制方法。在采集端,使用Kinect提取场景纹理和深度,并针对Kinect输出深度图的空洞提出一种快速修复算法。在显示端,针对单纹理+深度的基于深度图像的绘制(DIBR,depth image based rendering)绘制产生的大空洞,采用一种基于背景估计和前景分割的绘制方法。实验结果表明,本文方法可实时提取质量良好的深度图,并有效修复了DIBR绘制过程中产生的大空洞,得到质量较好的多路虚拟视点图像。以所提出的深度获取和绘制算法为核心,实现了一种基于深度的立体视频系统,最终的虚拟视点交织立体显示的立体效果良好,进一步验证了本文算法的有效性。本文系统可用于实景的多视点立体视频录制与播放。This paper proposes a real-time depth extraction algorithm based on Kinect and a multi-view rendering algorithm based on single color plus depth.At the acquisition side,we acquire color information and depth information by Kinect,and present a fast inpainting algorithm to inpaint holes in depth map output by Kinect.At the display side,to solve the big hole filling problem of depth image based rendering（DIBR） based on single color plus depth format,this paper presents a DIBR algorithm based on background estimation and foreground segmentation.Experiments show that our method can get good depth image in real-time,and effectively inpaint the big holes due to DIBR,so multiple virtual view images with good quality can be got.At last we implement a multi-view stereo video system based on the depth extraction and rendering algorithm.A good stereo perception can be achieved by interlacedly displaying the virtual views on auto-stereoscopic display,which further verifies the effectiveness of our method.This system can be used to record and display multi-view stereo videos for live scenes.

关 键 词：立体视频 深度提取 基于深度图像的绘制(DIBR) KINECT 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]