非真实感绘制技术研究现状与展望  

Research status and progress of non-photorealistic rendering technology

作　　者：钱文华[1,2] 曹进德 徐丹 吴昊[1] Qian Wenhua;Cao Jinde;Xu Dan;Wu Hao(School of Information Science and Engineering,Yunnan University,Kunming 650504,China;School of Automation,Southeast University,Nanjing 210009,China)

机构地区：[1]云南大学信息学院,昆明650504 [2]东南大学自动化学院,南京210009

出　　处：《中国图象图形学报》2020年第7期1283-1295,共13页Journal of Image and Graphics

基　　金：国家自然科学基金项目(61662087,61540062);云南省中青年学术技术带头人后备人才项目(2019HB121);云南省科技厅应用基础研究计划项目(2019FA044,2018FB100);云南省杰出青年培育项目(2018YDJQ016);全国第62批博士后科研基金项目(2017M621591);江苏省博士后科研基金项目(1108000197)。

摘　　要：非真实感绘制技术(non-photorealistic rendering,NPR)主要用于模拟艺术风格、表现艺术特质和传达用户情感等,是计算机图形学的重要组成部分,其研究对象逐渐丰富,研究方法不断创新。本文从基于图像建模的绘制方法、基于深度学习的绘制方法、中国特有艺术作品的数字化模拟、非真实感情感特征识别以及非真实感视频场景绘制等5个方面概述目前研究进展,然后从扩展非真实感研究对象、增强视频绘制帧间连贯性、提取艺术风格情感特征以及评价非真实感绘制结果等4个角度讨论需要进一步研究的问题。针对需要深入研究的问题,指出提高算法的通用性和绘制效率,以及提高深度学习网络的泛化性,有助于扩展研究对象,模拟艺术风格的多样性,同时减小视频场景的帧间跳变;对艺术风格作品具有的情感特征、内在机理特征进行模拟,有助于提高绘制结果与艺术风格图像的相似度;结合主观和客观评价模型,可以更准确地对绘制结果进行评价,同时有利于优化网络模型参数,提高绘制效率。非真实感绘制在计算机视觉、文化遗产保护等领域具有重要的应用前景,但其研究对象、绘制算法、绘制效率仍然存在很多亟待解决的问题,随着硬件设备的不断改进,综合运用学科交叉知识、扩展应用领域将进一步推动非真实感绘制技术的发展。Many art works have high artistic and commodity values.The production of realistic art works requires considerable time and strict manual skills.With the development of modern science and technology,the use of computer algorithms to synthesize and simulate different art styles is a popular topic in computer vision and image processing.Non-photorealistic rendering(NPR)technique mainly simulates art styles and expresses artistic characteristics.This technique is crucial for the protection and inheritance of art culture.Researchers have simulated and synthesized cartoon,sketch,oil painting,Chinese fine brushwork,calligraphy,and other art works on the basis of traditional image models.The development of deep learning has enabled researchers to use convolutional neural networks to transfer art features from style images to content images.In recent years,NPR research objects have been gradually enriched,research methods have been continuously enhanced,and the application fields of NPR have been expanding widely.However,the simulation and transfer of different styles using computers are challenges and open questions in NPR.This study reviews some NPR progresses in five important aspects,namely,traditional modeling rendering methods,depth learning transfer methods,digital simulation of Chinese unique art works,emotion recognition of art works,and artistic transfer from videos.We summarize the important stylized transfer methods in these aspects and show some simulation results.This paper further summarizes the issues that can be additional study fields in NPR,including research objects,video coherence among different frames,artistic style emotion,and evaluation criteria.Different art styles exist in the world,and the way to simulate these various works remain an open question.Although the transformation of video styles enriches the application field of NPR,it is a problem when the texture is complex,occlusion occurs,or the motion vector is inaccurate.Some artistic details are lost,which may cause discontinuity among vide

关 键 词：非真实感绘制 图像建模 数字化模拟 情感识别 评价标准 

分 类 号：TP301.6[自动化与计算机技术—计算机系统结构]