本文已被:浏览 264次 下载 736次
Received:December 25, 2023 Revised:January 23, 2024
Received:December 25, 2023 Revised:January 23, 2024
中文摘要: 多器官医学图像分割有助于医生做出临床诊断. 针对CNN提取全局特征能力弱, Transformer提取局部特征能力弱, 以及Transformer具有二次方计算复杂度的问题, 提出了用于多器官医学图像分割的多级特征交互Transformer模型. 所提模型采用CNN提取局部特征, 局部特征经Swin Transformer输出全局特征; 通过下采样分别产生多级局部和全局特征, 每级局部和全局特征经过交互并增强; 每级增强后的特征经多级特征融合模块进行交叉融合; 再次融合后的特征经过上采样和分割头输出分割掩码. 所提模型在Synapse和ACDC数据集上进行实验, 平均DSC和平均HD95系数值为80.16%和19.20 mm, 均优于LGNet和RFE-UNet等代表性模型. 该模型对多器官医学图像分割是有效的.
中文关键词: 多器官医学图像分割 多级特征交互 Transformer 卷积神经网络(CNN) 语义分割 深度学习
Abstract:Clinical diagnoses can be facilitated through the utilization of multi-organ medical image segmentation. This study proposes a multi-level feature interaction Transformer model to address the issues of weak global feature extraction capability in CNN, weak local feature extraction capability in Transformer, and the quadratic computational complexity problem of Transformer for multi-organ medical image segmentation. The proposed model employs CNN for extracting local features, which are then transformed into global features through Swin Transformer. Multi-level local and global features are generated through down-sampling, and each level of local and global features undergo interaction and enhancement. After the enhancement at each level, the features are cross-fused by multi-level feature fusion modules. The features, once again fused, pass through up-sampling and segmentation heads to produce segmentation masks. The proposed model is experimented on the Synapse and ACDC datasets, achieving average dice similarity coefficient (DSC) and average 95th percentile Hausdorff distance (HD95) values of 80.16% and 19.20 mm, respectively. These results outperform representative models such as LGNet and RFE-UNet. The proposed model is effective for multi-organ medical image segmentation.
keywords: multi-organ medical image segmentation multi-level feature interaction Transformer convolutional neural network (CNN) semantic segmentation deep learning
文章编号: 中图分类号: 文献标志码:
基金项目:重庆市教委科技研究项目(KJZD202200504); 重庆市自然科学基金创新发展联合基金(市教委)(CSTB2023NSCQ-LZX0142); 重庆市高等教育教学改革研究项目(232062)
引用文本:
武书磊,张方红,杨有,刘学文.多级特征交互Transformer的多器官图像分割.计算机系统应用,2024,33(6):232-241
WU Shu-Lei,ZHANG Fang-Hong,YANG You,LIU Xue-Wen.Multi-level Feature Interaction Transformer for Multi-organ Image Segmentation.COMPUTER SYSTEMS APPLICATIONS,2024,33(6):232-241
武书磊,张方红,杨有,刘学文.多级特征交互Transformer的多器官图像分割.计算机系统应用,2024,33(6):232-241
WU Shu-Lei,ZHANG Fang-Hong,YANG You,LIU Xue-Wen.Multi-level Feature Interaction Transformer for Multi-organ Image Segmentation.COMPUTER SYSTEMS APPLICATIONS,2024,33(6):232-241