PlaneStereo:Plane-aware Multi-view Stereo  

作　　者：Haoyu Guo Sida Peng Ting Shen Xiaowei Zhou 

机构地区：[1]State Key Lab of CAD&CG,Zhejiang University,Hangzhou,310058,China

出　　处：《Machine Intelligence Research》2024年第6期1092-1102,共11页机器智能研究（英文版）

摘　　要：Learning-based multi-view stereo(MVS)algorithms have demonstrated great potential for depth estimation in recent years.However,they still struggle to estimate accurate depth in texture-less planar regions,which limits their reconstruction perform-ance in man-made scenes.In this paper,we propose PlaneStereo,a new framework that utilizes planar prior to facilitate the depth estim-ation.Our key intuition is that pixels inside a plane share the same set of plane parameters,which can be estimated collectively using in-formation inside the whole plane.Specifically,our method first segments planes in the reference image,and then fits 3D plane paramet-ers for each segmented plane by solving a linear system using high-confidence depth predictions inside the plane.This allows us to recov-er the plane parameters accurately,which can be converted to accurate depth values for each point in the plane,improving the depth prediction for low-textured local regions.This process is fully differentiable and can be integrated into existing learning-based MVS al-gorithms.Experiments show that using our method consistently improves the performance of existing stereo matching and MVS al-gorithms on DeMoN and ScanNet datasets,achieving state-of-the-art performance.

关 键 词：Multi-view stereo scene reconstruction planar prior computer vision 3D vision 

分 类 号：TP242[自动化与计算机技术—检测技术与自动化装置] TP391.41[自动化与计算机技术—控制科学与工程]