结合可逆网络的超高分辨率图像的风格迁移  

Super-Resolution Image Style Transfer Combined with Reversible Network

作　　者：林真[1] 郑茜颖[1] LIN Zhen;ZHENG Qianying(College of Physics&Information Engineering,Fuzhou University,Fuzhou 350108,CHN)

机构地区：[1]福州大学物理与信息工程学院,福州350108

出　　处：《半导体光电》2023年第5期756-760,共5页Semiconductor Optoelectronics

基　　金：福建省科技重点产业引导项目(2020H0007)。

摘　　要：针对处理超高分辨率图像时面临的内存成本和风格迁移过程中过度风格化,提出了一种结合可逆网络的超高分辨率图像的风格迁移方法。该算法采用可逆的Glow模块作为基本单元构建可逆神经网络模块,并将图像分为小块处理;在风格迁移模块中使用具有通道注意力机制的残差模块和缩略图实例化归一化模块(TIN),以保证各模块风格一致;提出基于全局-局部的损失计算方式,能够有效地处理局部的结构特征。实验结果表明,相较于当前通用的各种神经风格迁移网络,所提算法不仅能够避免图像在编码和解码过程中的信息丢失问题,而且能以更低的内存成本实现更优的风格迁移。Aiming at the problem of memory consumption in ultra-high resolution image processing and the problem of over-stylization in the process of style transfer,a method of ultra-high resolution image style transfer combined with reversible network is proposed.The algorithm used the reversible Glow module as the basic unit to construct a reversible neural network module,and divided the image into small blocks for processing.In the style transfer module,a residual module with a channel attention mechanism and a thumbnail instantiation normalization module(TIN) were used to ensure that the styles of each module were consistent.A global-local loss calculation method was proposed,which could effectively deal with local structural features.Experimental results show that,compared with the current general-purpose neural style transfer network,this algorithm can not only avoid the information loss problem in the process of image encoding and decoding,but also achieve better style transfer performance at a lower memory cost.

关 键 词：可逆网络 超高分辨率图像 风格迁移 通道注意力机制 Glow模块 

分 类 号：TP389.1[自动化与计算机技术—计算机系统结构]