Deep panoramic depth prediction and completion for indoor scenes  

作　　者：Giovanni Pintore Eva Almansa Armando Sanchez Giorgio Vassena Enrico Gobbetti 

机构地区：[1]Visual and Data-intensive Computing,CRS4,Cagliari 09134,Italy [2]Gexcel srl,Elmas(CA)09097,Italy [3]Department of Civil,Environment,Architectural Engineering,and Mathematics(DICATAM),Universita degli Studi di Brescia(UNIBS),Brescia(BS)25123,Italy.

出　　处：《Computational Visual Media》2024年第5期903-922,共20页计算可视媒体（英文版）

基　　金：funding from the Autonomous Region of Sardinia under project XDATA.Eva Almansa,Armando Sanchez,Giorgio Vassena,and Enrico Gobbetti received funding from the European Union's H2020 research and innovation programme under grant 813170(EVOCATION).

摘　　要：We introduce a novel end-to-end deeplearning solution for rapidly estimating a dense spherical depth map of an indoor environment.Our input is a single equirectangular image registered with a sparse depth map,as provided by a variety of common capture setups.Depth is inferred by an efficient and lightweight single-branch network,which employs a dynamic gating system to process together dense visual data and sparse geometric data.We exploit the characteristics of typical man-made environments to efficiently compress multiresolution features and find short-and long-range relations among scene parts.Furthermore,we introduce a new augmentation strategy to make the model robust to different types of sparsity,including those generated by various structured light sensors and LiDAR setups.The experimental results demonstrate that our method provides interactive performance and outperforms stateof-the-art solutions in computational efficiency,adaptivity to variable depth sparsity patterns,and prediction accuracy for challenging indoor data,even when trained solely on synthetic data without any fine tuning.

关 键 词：machine learning image processing and computervision visionand scene understanding 3D stereo scene analysis 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]