医学影像疾病诊断的残差神经网络优化算法研究进展  

Progress of residual neural network optimization algorithm for medical imaging disease diagnosis

作　　者：周涛 霍兵强 陆惠玲[2] 师宏斌[4] Zhou Tao;Huo Bingqiang;Lu Huiling;Shi Hongbin(School of Computer Science and Engineering,North Minzu University,Yinchuan 750021,China;School of Science,Ningxia Medical University,Yinchuan 750004,China;Ningxia Key Laboratory of Intelligent Information and Big Data Processing,Yinchuan 750021,China;Department of Urology,The General Hospital of Ningxia Medical University,Yinchuan 750004,China)

机构地区：[1]北方民族大学计算机科学与工程学院,银川750021 [2]宁夏医科大学理学院,银川750004 [3]宁夏智能信息与大数据处理重点实验室,银川750021 [4]宁夏医科大学总医院泌尿外科,银川750004

出　　处：《中国图象图形学报》2020年第10期2079-2092,共14页Journal of Image and Graphics

基　　金：国家自然科学基金项目(61561040);北方民族大学引进人才科研启动项目(2020KYQD08)。

摘　　要：残差神经网络(residual neural network,ResNet)及其优化是深度学习研究的热点之一,在医学图像领域应用广泛,在肿瘤、心脑血管和神经系统疾病等重大疾病的临床诊断、分期、转移、治疗决策和靶区勾画方面取得良好效果。本文对残差神经网络的学习优化进行了总结:阐述了残差神经网络学习算法优化,从激活函数、损失函数、参数优化算法、学习衰减率、归一化和正则化技术等6方面进行总结,其中激活函数的改进方法主要有Sigmoid、tanh、ReLU、PReLU(parameteric ReLU)、随机化ReLU(randomized leaky ReLU,RReLU)、ELU(exponential linear units)、Softplus函数、NoisySoftplus函数以及Maxout共9种;损失函数主要有交叉熵损失、均方损失、欧氏距离损失、对比损失、合页损失、Softmax-Loss、L-Softmax Loss、A-Softmax Loss、L2 Softmax Loss、Cosine Loss、Center Loss和焦点损失共12种;学习率衰减总结了8种,即分段常数衰减、多项式衰减、指数衰减、反时限衰减、自然指数衰减、余弦衰减、线性余弦衰减和噪声线性余弦衰减;归一化算法有批量归一化和提出批量重归一化算法;正则化方法主要有增加输入数据、数据增强、早停法、L1正则化、L2正则化、Dropout和Dropout Connect共7种。综述了残差网络模型在医学图像疾病诊断中的应用研究,梳理了残差神经网络在肺部肿瘤、皮肤疾病、乳腺癌、大脑疾病、糖尿病和血液病等6种疾病诊断中的应用研究;对深度学习在医学图像未来发展进行了总结和展望。Residual neural network(ResNet)has gained considerable attention in deep learning research over the last few years and has made great achievements in computer vision.The deep convolutional network represented by ResNet is increasingly used in the field of medical imaging and has achieved good results in the clinical diagnosis,staging,metastasis,treatment decision,and target area delineation of major diseases,such as tumors,cardiovascular and cerebrovascular diseases,and nervous system diseases.The optimization of the ResNet algorithm is an important part of the ResNet research.It largely determines model performance,such as generalization and convergence.This article summarizes the learning optimization of ResNet.First,the optimization of the learning algorithm of ResNet is elaborated,and the six aspects of activation function,loss function,parameter optimization algorithm,learning decay rate algorithm,normalization,and regularization are summarized.Nine improvement methods exist for the activation function;they are sigmoid,tanh,ReLU,PReLU,randomized ReLU,exponential linear units(ELU),softplus function,noisy softplus function,and maxout.The loss function includes 12 types:cross-entropy,mean square,Euclidean distance,contrast,hinge,softmax,L-softmax,A-softmax,L2 softmax,cosine,center,and focus losses.Eight learning rate decay methods,namely,piecewise constant,polynomial,exponential,inverse time,natural exponential,cosine,linear cosine,and noise linear cosine,are summarized.The normalization algorithms include batch normalization and renormalization.The regularization technologies include seven types:input data,data enhancement,early stop method,L1 regularization,L2 regularization,dropout,and dropout connect.Second,the application study of the residual network model in the diagnosis of medical imaging diseases is reviewed.ResNet is used to diagnose six types of diseases:lung tumor,skin disease,breast cancer,brain disease,diabetes,and hematological disease.1)Lung cancer.Considerable data show that the incidence of l

关 键 词：深度学习 残差神经网络 优化算法 医学图像 疾病诊断 

分 类 号：TP399[自动化与计算机技术—计算机应用技术]