基于机器学习的三维场景高度真实感绘制方法综述  

State-of-the-art Survey on Photorealistic Rendering of 3D Sences Based on Machine Learning

作　　者：赵烨梓 王璐 徐延宁[1,2] 曾峥[1,2] 葛亮昇 朱君秋 徐子林 赵钰 孟祥旭 ZHAO Ye-Zi;WANG Lu;XU Yan-Ning;ZENG Zheng;GE Liang-Sheng;ZHU Jun-Qiu;XU Zi-Lin;ZHAO Yu;MENG Xiang-Xu(School of Software,Shandong University,Jinan 250101,China;Engineering Research Center of Digital Media Technology,Ministry of Education,Jinan 250101,China)

机构地区：[1]山东大学软件学院,山东济南250101 [2]数字媒体技术教育部工程研究中心,山东济南250101

出　　处：《软件学报》2022年第1期356-376,共21页Journal of Software

基　　金：国家重点研发计划(2020YFB1708900);国家自然科学基金(61872223);山东省自然科学基金(ZR2020LZH016)。

摘　　要：目前,电影、动漫、游戏等产业对真实感绘制的需求越来越高,而三维场景高度真实感绘制通常需要耗费大量的计算时间和存储空间来计算全局光照,如何在保证绘制质量的前提下提升绘制速度依然是图形学领域面临的核心和热点问题之一.数据驱动的机器学习方法开辟了一种新的研究思路,近年来研究者将多种高度真实感绘制方法映射为机器学习问题,从而大大降低了计算成本.总结分析了近年来基于机器学习的高度真实感绘制方法的研究进展,具体包括:基于机器学习的全局光照优化计算方法、基于深度学习的物理材质建模方法、基于深度学习的参与性介质优化绘制方法、基于机器学习的蒙特卡洛降噪方法等.详细论述了各种绘制方法与机器学习方法的映射思路,归纳总结了网络模型以及训练数据集的构建方式,并在绘制质量、绘制时间、网络能力等多个方面开展了对比分析.最后,本文提出了机器学习和真实感绘制相结合的可能思路和未来展望.Nowadays,the demand for photorealistic rendering in the movie,anime,game,and other industries is increasing,and the highly realistic rendering of 3D scenes usually requires a lot of calculation time and storage to calculate global illumination.How to ensure the quality of rendering on the premise of improving drawing speed is still one of the core and hot issues in the field of graphics.The data-driven machine learning method has opened up a new approach.In recent years,researchers have mapped a variety of highly realistic rendering methods to machine learning problems,thereby greatly reducing the computational cost.This article summarizes and analyzes the research progress of highly realistic rendering methods based on machine learning in recent years,including:global illumination optimization calculation methods based on machine learning,physical material modeling methods based on deep learning,and participatory media drawing method optimization based on deep learning,Monte Carlo denoising method based on machine learning,etc.This article discusses the mapping ideas of various drawing methods and machine learning methods in detail,summarizes the construction methods of network models and training data sets,and conducts comparative analysis on drawing quality,drawing time,network capabilities,and other aspects.Finally,this article proposes possible ideas and future prospects for the combination of machine learning and realistic rendering.

关 键 词：真实感绘制 机器学习 全局光照 基于物理的材质模型 蒙特卡洛降噪 

分 类 号：TP309[自动化与计算机技术—计算机系统结构]