融合CNN与Transformer的MRI脑肿瘤图像分割  

MRI brain tumor image segmentation by fusing CNN and Transformer

作　　者：刘万军[1] 姜岚 曲海成[1] 王晓娜 崔衡 LIU Wanjun;JIANG Lan;QU Haicheng;WANG Xiaona;CUI Heng(School of Software,Liaoning Technical University,Huludao 125105,China)

机构地区：[1]辽宁工程技术大学软件学院,辽宁葫芦岛125105

出　　处：《智能系统学报》2024年第4期1007-1015,共9页CAAI Transactions on Intelligent Systems

基　　金：辽宁省高等学校基本科研项目(LJKMZ20220699);辽宁工程技术大学学科创新团队项目(LNTU20T-D-23).

摘　　要：为解决卷积神经网络(convolutional neural network,CNN)在学习全局上下文信息和边缘细节方面受到很大限制的问题,提出一种同时学习局语义信息和局部空间细节的级联神经网络用于脑肿瘤医学图像分割。首先将输入体素分别送入CNN和Transformer分支,在编码阶段结束后,采用一种双分支融合模块将2个分支学习到的特征有效地结合起来以实现全局信息与局部信息的融合。双分支融合模块利用哈达玛积对双分支特征之间的细粒度交互进行建模,同时使用多重注意力机制充分提取特征图通道和空间信息并抑制无效的噪声信息。在BraTS竞赛官网评估了本文方法,在BraTS2019验证集上增强型肿瘤区、全肿瘤区和肿瘤核心区的Dice分数分别为77.92%,89.20%和81.20%。相较于其他先进的三维医学图像分割方法,本文方法表现出了更好的分割性能,为临床医生做出准确的脑肿瘤细胞评估和治疗方案提供了可靠依据。This study presents a cascaded neural network that learns both global semantic information and local spatial details for medical image segmentation of brain tumors,solving the problem that convolutional neural networks(CNN)are greatly restricted in learning global contextual information and edge details.First,the input voxels are fed into the CNN and Transformer branches separately.After the encoding phase,a two-branch fusion module is used to effectively combine the features learned in both branches to achieve the fusion of global and local information.The two-branch fusion module uses Hadamard products to model the fine-grained interactions between the two-branch features,while using multiple attention mechanisms to fully extract the feature map channels and spatial information and suppress the invalid noise information.The method of this paper has been evaluated on the BraTS competition website,with Dice scores of 77.92%,89.20%and 81.20%for the enhanced tumor region,full tumor region and tumor core region on the BraTS2019 validation set,respectively.Compared with other advanced 3D medical image segmentation methods,this method shows better segmentation performance,which provides a reliable basis for clinicians to make accurate brain tumor cell assessment and treatment plans.

关 键 词：医学图像分割 脑肿瘤 级联神经网络 卷积神经网络 TRANSFORMER 特征融合 多重注意力 残差学习 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]