Closed-loop Segmentation Network Based on Dual-branch Encoding
CSTR:
Author:
  • Article
  • | |
  • Metrics
  • |
  • Reference [23]
  • |
  • Related [20]
  • | | |
  • Comments
    Abstract:

    In the Transformer model, the convolutional vision Transformer (CvT) has caught attention for its ability to extract both local and global features from images simultaneously. However, for abdominal organ segmentation tasks, the blurry object boundaries in CNN models should be addressed. Thus, this study proposes a novel dual-branch closed-loop segmentation model DBLNet based on CvT and CNN. The model employs explicit supervision of segmented contours using shape priors and predicted results to guide the network learning. The DBLNet model includes contour extraction encoding module (CEE), boundary shape segmentation network (BSSN), and closed-loop structure. The CEE module first utilizes modified 3D CvT and 3D gated convolutional layers (GCL) to capture multi-level contour features and assist in BSSN training. The BSSN module contains a shape feature fusion (SFF) module that captures both the object region and contour features to promote CEE training convergence. The closed-loop structure allows mutual feedback of segmentation results between the dual branches, assisting each other’s training. Experimental evaluations on the BTCV benchmark show that DBLNet achieves an average Dice score of 0.878, ranking 13th. Application tests on clinical hospital data demonstrate the strong performance of the proposed model.

    Reference
    [1] 黄晓鸣, 何富运, 唐晓虎, 等. U-Net及其变体在医学图像分割中的应用研究综述. 中国生物医学工程学报, 2022, 41(5): 567–576.
    [2] He AL, Wang K, Li T, et al. H2Former: An efficient hierarchical hybrid Transformer for medical image segmentation. IEEE Transactions on Medical Imaging, 2023, 42(9): 2763–2775.
    [3] Wu HP, Xiao B, Codella N, et al. CvT: Introducing convolutions to vision Transformers. Proceedings of 2021 IEEE/CVF International Conference on Computer Vision. Montreal: IEEE, 2021. 22–31.
    [4] Liu TR, Huang JJ, Dai TH, et al. Gated multi-layer convolutional feature extraction network for robust pedestrian detection. Proceedings of the 2020 IEEE International Conference on Acoustics, Speech and Signal Processing. Barcelona: IEEE, 2020. 3867–3871.
    [5] 徐光宪, 冯春, 马飞. 基于UNet的医学图像分割综述. 计算机科学与探索, 2023, 17(8): 1776–1792.
    [6] Oktay O, Schlemper J, Folgoc LL, et al. Attention U-Net: Learning where to look for the pancreas. arXiv:1804.03999, 2018.
    [7] Meng YD, Zhang HR, Zhao YT, et al. Graph-based region and boundary aggregation for biomedical image segmentation. IEEE Transactions on Medical Imaging, 2022, 41(3): 690–701.
    [8] Lin Y, Zhang D, Fang X, et al. Rethinking boundary detection in deep learning models for medical image segmentation. Proceedings of the 28th International Conference on Information Processing in Medical Imaging. San Carlos de Bariloche: Springer, 2023. 730–742.
    [9] Liu XW, Hu YK, Chen JG, et al. Shape and boundary-aware multi-branch model for semi-supervised medical image segmentation. Computers in Biology and Medicine, 2022, 143: 105252.
    [10] Raffel C, Shazeer N, Roberts A, et al. Exploring the limits of transfer learning with a unified text-to-text Transformer. The Journal of Machine Learning Research, 2020, 21(1): 140.
    [11] Xu GP, Wu XR, Zhang X, et al. LeViT-UNet: Make faster encoders with transformer for medical image segmentation. arXiv:2107.08623, 2021.
    [12] Zhang JP, Xie YT, Wang Y, et al. Inter-slice context residual learning for 3D medical image segmentation. IEEE Transactions on Medical Imaging, 2021, 40(2): 661–672.
    [13] Chen JN, Lu YY, Yu QH, et al. TransUNet: Transformers make strong encoders for medical image segmentation. arXiv:2102.04306, 2021.
    [14] Hatamizadeh A, Tang YC, Nath V, et al. UNETR: Transformers for 3D medical image segmentation. Proceedings of the 2022 IEEE/CVF Winter Conference on Applications of Computer Vision. Waikoloa: IEEE, 2022. 1748–1758.
    [15] Hatamizadeh A, Nath V, Tang YC, et al. Swin UNETR: Swin transformers for semantic segmentation of brain tumors in MRI images. Proceedings of the 7th International Workshop on Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries. Philadelphia: Springer, 2021. 272–284.
    [16] Larsson M, Zhang YH, Kahl F, et al. Robust abdominal organ segmentation using regional convolutional neural networks. Applied Soft Computing, 2018, 70: 465–471.
    [17] Liu Z, Lin YT, Cao Y, et al. Swin Transformer: Hierarchical vision transformer using shifted windows. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision. Montreal: IEEE, 2021. 9992–10002.
    [18] Yuan L, Chen YP, Wang T, et al. Tokens-to-token ViT: Training vision transformers from scratch on ImageNet. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision. Montreal: IEEE, 2021. 538–547.
    [19] Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need. Proceedings of the 31st International Conference on Neural Information Processing Systems. Long Beach: Curran Associates Inc., 2017. 6000–6010.
    [20] 李祥健, 朱家明, 徐婷宜. 基于改进Canny算子的双水平集医学图像分割. 无线电通信技术, 2021, 47(2): 226–231.
    [21] Xie Z, Wang HM, Wu L. The improved Douglas-Peucker algorithm based on the contour character. Proceedings of the 19th International Conference on Geoinformatics. Shanghai: IEEE, 2011. 1–5.
    [22] 陈英, 张伟, 林洪平, 等. 医学图像分割算法的损失函数综述. 生物医学工程学杂志, 2023, 40(2): 392–400.
    [23] Zhou YY, Li Z, Bai S, et al. Prior-aware neural network for partially-supervised multi-organ segmentation. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision. Seoul: IEEE, 2019. 10671–10680.
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

任玉涛,程远志.基于双分支编码的闭环分割网络.计算机系统应用,2024,33(1):110-118

Copy
Share
Article Metrics
  • Abstract:546
  • PDF: 1875
  • HTML: 1080
  • Cited by: 0
History
  • Received:July 08,2023
  • Revised:August 08,2023
  • Online: November 28,2023
  • Published: January 05,2023
Article QR Code
You are the first992264Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-3
Address:4# South Fourth Street, Zhongguancun,Haidian, Beijing,Postal Code:100190
Phone:010-62661041 Fax: Email:csa (a) iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063