面向六自由度视频应用的多视点视频码率分配  

Bitrate allocation of multiview video for six degree of freedom video application

作　　者：程金婷 彭宗举 王晓东[1] 陈芬 束争杰 CHENG Jin-ting;PENG Zong-ju;WANG Xiao-dong;CHEN Fen;SHU Zheng-jie(Faculty of Information Science and Engineering,Ningbo University,Ningbo 315211,China;School of Electrical and Electronic Engineering,Chongqing University of Technology,Chongqing 400054,China)

机构地区：[1]宁波大学信息科学与工程学院,宁波315211 [2]重庆理工大学电气与电子工程学院,重庆400054

出　　处：《光电子．激光》2020年第9期994-1000,共7页Journal of Optoelectronics·Laser

基　　金：国家自然科学基金(61771269,61620106012);浙江省自然科学基金(LY20F010005);宁波市自然科学基金(2018A610052,2019A610107)资助项目。

摘　　要：六自由度(Six Degree of Freedom,6DoF)视频系统允许用户从全方位、以任意视角身临其境地体验场景,是沉浸式视频技术的发展方向。根据6DoF视频系统中用户观看位置的变化,对多视点彩色与深度视频的码率分配是高质量场景生成的关键。本文从虚拟视点的失真出发,提出一种基于虚拟视点质量预测(Quality prediction model of virtual view,QPMVV)模型的视点级码率分配方法。首先理论分析了彩色和深度视频编码失真和虚拟视点失真的关系,然后通过实验统计分析了虚拟视点质量与彩色和深度视频编码量化参数的关系,建立了多视点彩色和深度视频的QPMVV模型,最后推导出多视点彩色和深度视频的相关视点的码率分配比例。实验表明,与平均分配的方法相比,本文码率分配方法能显著提升虚拟视点的主观和客观质量。虚拟视点越偏离中心位置,质量改善越明显。Six degree of freedom(6 DoF)video system allows users to experience the scene from arbitrary viewpoints and perspectives,which is the development direction of immersive video technology.According to the change of user′s viewing position in 6 DOF video system,the rate allocation of multiview color and depth video is the key of high quality scene generation.A bitrate allocation scheme for area multiview video based on the quality prediction model of virtual view(QPMVV)is proposed accordingly.Firstly,the relation between the virtual view distortion and the coding distortion of color and depth videos is theoretically analyzed.Then,explorative experiments are performed to further analyze the effect of the coding distortion on the virtual view quality,and the QPMVV model of multiview color and depth video is established.Finally,according to the prediction model and the constraint optimization theory,the view-level allocation weights of texture and depth video are further derived.Experimental results show that,compared with the average allocation method,the proposed method can significantly improve the subjective and objective quality of virtual views.The degree of quality improvement is related to the degree to which the virtual view position deviates from the center of the reference views.The greater the deviation,the more obvious the quality improvement.

关 键 词：六自由度 多视点视频 平面分布相机阵列 虚拟视点绘制 码率分配 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]