三维视觉前沿进展  

Recent progress in 3D vision

作　　者：龙霄潇 程新景 朱昊[3,2] 张朋举 刘浩敏 李俊 郑林涛[7] 胡庆拥 刘浩 曹汛[3] 杨睿刚[2] 吴毅红 章国锋[10] 刘烨斌 徐凯[7] 郭裕兰[7] 陈宝权[12] Long Xiaoxiao;Cheng Xinjing;Zhu Hao;Zhang Pengju;Liu Haomin;Li Jun;Zheng Lintao;Hu Qingyong;Liu Hao;Cao Xun;Yang Ruigang;Wu Yihong;Zhang Guofeng;Liu Yebin;Xu Kai;Guo Yulan;Chen Baoquan(The University of Hong Kong,Hong Kong 999077,China;Jiluo Technology(Shanghai)Co.,Ltd.,Shanghai 200000,China;Nanjing University,Nanjing 210023,China;Institute of Automation,Chinese Academy of Sciences,Beijing 100190,China;School of Artificial Intelligence,University of Chinese Academy of Sciences,Beijing 100190,China;SenseTime Research Institute,Hangzhou 311215,China;National University of Defense Technology,Changsha 410073,China;University of Oxford,Oxford 0X13QR,United Kingdom;Sun Yat-sen University,Guangzhou 510275,China;Zhejiang University,Hangzhou 310058,China;Tsinghua University,Beijing 100085,China;Peking University,Beijing 100871,China)

机构地区：[1]香港大学,中国香港999077 [2]际络科技(上海)有限公司,上海200000 [3]南京大学,南京210023 [4]中国科学院自动化研究所,北京100190 [5]中国科学院大学人工智能学院,北京100190 [6]商汤研究院,杭州311215 [7]国防科技大学,长沙410073 [8]牛津大学,牛津OX13QR [9]中山大学,广州510275 [10]浙江大学,杭州310058 [11]清华大学,北京100085 [12]北京大学,北京100871

出　　处：《中国图象图形学报》2021年第6期1389-1428,共40页Journal of Image and Graphics

摘　　要：在自动驾驶、机器人、数字城市以及虚拟/混合现实等应用的驱动下,三维视觉得到了广泛的关注。三维视觉研究主要围绕深度图像获取、视觉定位与制图、三维建模及三维理解等任务而展开。本文围绕上述三维视觉任务,对国内外研究进展进行了综合评述和对比分析。首先,针对深度图像获取任务,从非端到端立体匹配、端到端立体匹配及无监督立体匹配3个方面对立体匹配研究进展进行了回顾,从深度回归网络和深度补全网络两个方面对单目深度估计研究进展进行了回顾。其次,针对视觉定位与制图任务,从端到端视觉定位和非端到端视觉定位两个方面对大场景下的视觉定位研究进展进行了回顾,并从视觉同步定位与地图构建和融合其他传感器的同步定位与地图构建两个方面对同步定位与地图构建的研究进展进行了回顾。再次,针对三维建模任务,从深度三维表征学习、深度三维生成模型、结构化表征学习与生成模型以及基于深度学习的三维重建等4个方面对三维几何建模研究进展进行了回顾,并从多视RGB重建、单深度相机和多深度相机方法以及单视图RGB方法等3个方面对人体动态建模研究进展进行了回顾。最后,针对三维理解任务,从点云语义分割和点云实例分割两个方面对点云语义理解研究进展进行了回顾。在此基础上,给出了三维视觉研究的未来发展趋势,旨在为相关研究者提供参考。3 D vision has numerous applications in various areas,such as autonomous vehicles,robotics,digital city,virtual/mixed reality,human-machine interaction,entertainment,and sports.It covers a broad variety of research topics,ranging from 3 D data acquisition,3 D modeling,shape analysis,rendering,to interaction.With the rapid development of 3 D acquisition sensors(such as low-cost LiDARs,depth cameras,and 3 D scanners),3 D data become even more accessible and available.Moreover,the advances in deep learning techniques further boost the development of 3 D vision,with a large number of algorithms being proposed recently.We provide a comprehensive review on progress of 3 D vision algorithms in recent few years,mostly in the last year.This survey covers seven different topics,including stereo matching,monocular depth estimation,visual localization in large-scale scenes,simultaneous localization and mapping(SLAM),3 D geometric modeling,dynamic human modeling,and point cloud understanding.Although several surveys are now available in the area of 3 D vision,this survey is different from few aspects.First,this study covers a wide range of topics in 3 D vision and can therefore benefit a broad research community.On the contrary,most existing works mainly focus on a specific topic,such as depth estimation or point cloud learning.Second,this study mainly focuses on the progress in very recent years.Therefore,it can provide the readers with up-to-date information.Third,this paper presents a direct comparison between the progresses in China and abroad.The recent progress in depth image acquisition,including stereo matching and monocular depth estimation,is initially reviewed.The stereo matching algorithms are divided into non-end-to-end stereo matching,end-to-end stereo matching,and unsupervised stereo matching algorithms.The monocular depth estimation algorithms are categorized into depth regression networks and depth completion networks.The depth regression networks are further divided into encoder-decoder networks and composit

关 键 词：立体匹配 单目深度估计 视觉定位 同步定位与地图构建(SLAM) 三维几何建模 人体动态重建 点云语义理解 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]