融合多尺度语义和双分支并行的医学图像分割网络  

Medical image segmentation network integrating multi-scale semantics and parallel double-branch

作　　者：袁宝华 陈佳璐 王欢[2] YUAN Baohua;CHEN Jialu;WANG Huan(School of Computer Science and Artificial Intelligence,Changzhou University,Changzhou Jiangsu 213159,China;School of Computer Science and Engineering,Nanjing University of Science and Technology,Nanjing Jiangsu 210094,China)

机构地区：[1]常州大学计算机与人工智能学院,江苏常州213159 [2]南京理工大学计算机科学与工程学院,南京210094

出　　处：《计算机应用》2025年第3期988-995,共8页journal of Computer Applications

基　　金：国家自然科学基金资助项目(61703209)。

摘　　要：在医学图像分割网络中,卷积神经网络(CNN)虽然能提取丰富的局部特征细节,但存在远程信息捕获不足的问题。Transformer虽然可以捕捉长距离的全局特征依赖关系,但是会破坏局部特征细节。为充分利用2种网络特征的互补性,提出一种用于医学图像分割的CNN和Transformer并行的融合网络——PFNet。该网络的并行融合模块使用一对基于CNN和Transformer的相互依赖的并行分支来高效地学习局部和全局两方面的辨别特征,并以交互方式交叉融合局部特征和长距离特征的依赖关系;同时,为恢复在下采样期间丢失的空间信息以增强细节的保留,提出多尺度交互(MSI)模块提取分层CNN分支生成的多尺度特征的局部上下文以进行远程依赖关系建模。实验结果表明,PFNet优于MISSFormer(Medical Image Segmentation tranSFormer)和UCTransNet(U-Net with Channel Transformer module)等先进方法。在Synapse和ACDC(Automated Cardiac Diagnosis Challenge)数据集上,相较于最优的基线方法MISSFormer,PFNet的平均Dice相似系数(DSC)分别提高1.27%和0.81%。可见,PFNet能实现更精准的医学图像分割。In medical image segmentation networks,Convolutional Neural Network(CNN)can extract rich local feature details,but has the problem of insufficient capture of long-range information,and Transformer can capture long-range global feature dependencies,but destroys local feature details.To make full use of the complementarity of characteristics of the two networks,a parallel fusion network of CNN and Transformer for medical image segmentation was proposed,named PFNet.In the parallel fusion module of this network,a pair of interdependent parallel branches based on CNN and Transformer were used to learn both local and global discriminative features efficiently,and fuse local features and long-distance feature dependencies interactively.At the same time,to recover the spatial information lost during downsampling to enhance detail retention,a Multi-Scale Interaction(MSI)module was proposed to extract the local context of multi-scale features generated by hierarchical CNN branches for long-range dependency modeling.Experimental results show that PFNet outperforms other advanced methods such as MISSFormer(Medical Image Segmentation tranSFormer)and UCTransNet(U-Net with Channel Transformer module).On Synapse and ACDC(Automated Cardiac Diagnosis Challenge)datasets,compared to the optimal baseline method MISSFormer,PFNet increases the average Dice Similarity Coefficient(DSC)by 1.27%and 0.81%,respectively.It can be seen that PFNet can realize more accurate medical image segmentation.

关 键 词：医学图像分割 TRANSFORMER 卷积神经网络 并行融合 多尺度交互 

分 类 号：TP391.4[自动化与计算机技术—计算机应用技术]