PU-NET Deep Learning Architecture for Gliomas Brain Tumor Segmentation in Magnetic Resonance Images
DOI:
https://doi.org/10.5566/ias.2879Keywords:
image segmentation, deep learning, Brain Tumour, Gliomas, U-Net.Abstract
Automatic medical image segmentation is one of the main tasks for many organs and pathology structures delineation. It is also a crucial technique in the posterior clinical examination of brain tumors, like applying radiotherapy or tumor restrictions. Various image segmentation techniques have been proposed and applied to different image types. Recently, it has been shown that the deep learning approach accurately segments images, and its implementation is usually straightforward. In this paper, we proposed a novel approach, called PU-NET, for automatic brain tumor segmentation in multi-modal magnetic resonance images (MRI). We introduced an input processing block to a customized fully convolutional network derived from the U-Net network to handle the multi-modal inputs. We performed experiments over the Brain Tumor Segmentation (BRATS) dataset collected in 2018 and achieved Dice scores of 90.5%, 82.7%, and 80.3% for the whole tumor, tumor core, and enhancing tumor classes, respectively. This study provides promising results compared to the deep learning methods used in this context.
References
A.Albiol A, Antonio A, Francisco A (2019). Extending 2D Deep Learning Architectures to 3D Image Segmentation Problems. In: Brainlesion: Glioma, Multiple Sclerosis,Stroke and Traumatic Brain Injuries. BrainLes 2018. Lecture Notes in ComputerScience, vol. 1. Springer International Publishing.
Ait Skourt B, El Hassani A, Majda A (2018). Lung CT image segmentation using deep neural networks. Procedia Computer Science 127:109–13.
Ayachi R, Ben Amor N (2009). Brain tumor segmentation using support vector machines. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 5590 LNAI.
Bakas S, Akbari H, Sotiras A, Bilello M, Rozycki M, Kirby JS, al E (2017). Advancing The Cancer Genome Atlas glioma MRI collections with expert segmentation labels and radiomic features. Scientific Data 4:170117.
Bakas S, Reyes M, Jakab A, Bauer S, Rempfler M, Crimi A, al E (2018). Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challenge. arXiv .
Bal A, Banerjee M, Sharma P, Maitra M (2018). Brain tumor segmentation on mr image using k-means and fuzzy-possibilistic clustering. In: 2018 2nd International Conference on Electronics, Materials Engineering & Nano-Technology(IEMENTech).
BRANDAL G, et al. (2018). Conventional and advanced magnetic resonance imaging in patients with high-grade glioma. The quarterly journal of nuclear medicine and molecular imaging official publication of the Italian Association of Nuclear Medicine AIMNand the International Association of Radiopharmacology IARand Section of the Society of 62:239.
Bush NAO, Chang S (2016). Treatment strategies for low-grade glioma in adults. Journal of Oncology Practice 12:1235–41.
Crimi A, Bakas S, Kuijf H, Keyvan F, Reyes M, van Walsum T, eds. (2019). Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries, vol. 11384 of Lecture Notes in Computer Science. Cham: Springer International Publishing.
Crimi A, Bakas S, Kuijf H, Menze B, Reyes M, eds. (2018). Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries, vol. 10670 of Lecture Notes in Computer Science. Cham: Springer International Publishing.
Deng W, Xiao W, Deng H, Liu J (2010). MRI brain tumor segmentation with region growing method based on the gradients and variances along and inside of the boundary curve. In: Proceedings - 2010 3rd International Conference on Biomedical Engineering and Informatics, BMEI 2010, vol. 1.
Huttenlocher D, Klanderman G, Rucklidge W (1993). Comparing images using the Hausdorff distance. IEEE Transactions on Pattern Analysis and Machine Intelligence15:850–63.
Isensee F, Kickingereder P, Wick W, Bendszus M, Maier-Hein KH (2019). No new net. In: Crimi A., Bakas S., Kuijf H., Keyvan F., Reyes M., van Walsum T.(eds) Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries.BrainLes 2018. Lecture Notes in Computer Science, vol. 11384 LNCS.
Isin A, Direkoglu C, S¸ah M (2016). Review of MRI-based Brain Tumor Image Segmentation Using Deep Learning Methods. Procedia Computer Science 102:317–24.
Jadon S (2020). A survey of loss functions for semantic segmentation. 2020 IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology CIBCB 2020 .
Jalab HA, Hasan AM (2019). Magnetic Resonance Imaging Segmentation Techniques of Brain Tumors : A Review. The Journal of Neuroscience The Official Journal of the Society for Neuroscience 6:1–7.
Jiang Z, Ding C, Liu M, Tao D (2020). Two-Stage Cascaded U-Net: 1st Place Solution to BraTS Challenge 2019 Segmentation Task. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11992 LNCS. Springer International Publishing.
Kamnitsas K, Bai W, Ferrante E, McDonagh S, Sinclair M, Pawlowski N, Rajchl M, Lee M, Kainz B, Rueckert D, Glocker B (2017). Ensembles of Multiple Models and Architectures for Robust Brain Tumour Segmentation. In: BrainLes@MICCAI.
Kapas Z, Lefkovits L, Szil ´ agyi L (2016). Automatic Detection and Segmentation of Brain ´Tumor Using Random Forest Approach. In: Torra V, Narukawa Y, Navarro-Arribas G,Yanez C, eds., Lecture Notes in Artificial Intelligence (Subseries of Lecture Notes in ˜Computer Science), vol. 9880 of Lecture Notes in Computer Science. Cham: Springer
International Publishing, 301–12.
Kaur D, Kaur Y (2014). Various image segmentation techniques: a review. International Journal of Computer Science and Mobile Computing 3:809–14.
Kermi A, Mahmoudi I, Khadir MT (2019). Deep Convolutional Neural Networks Using U-Net for Automatic Brain Tumor Segmentation in Multimodal MRI Volumes.In: Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries. BrainLes 2018. Lecture Notes in Computer Science, vol. 2. Springer International
Publishing.
Kumar A, Bi L, Kim J, Feng DD (2020). Machine learning in medical imaging. In:Biomedical Information Technology. Elsevier Inc., 167–96.
Li S, Dong M, Du G, Mu X (2019). Attention Dense-U-Net for Automatic Breast Mass Segmentation in Digital Mammogram. IEEE Access 7:59037–47.
Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, van der Laak JA,van Ginneken B, Sanchez CI (2017). A survey on deep learning in medical image ´analysis.
Lu L, Shin Y, Su Y, Karniadakis GE (2019). Dying relu and initialization: Theory and numerical examples. ArXiv abs/1903.06733.
Magadza T, Viriri S (2021). Deep learning for brain tumor segmentation: A survey of state-of-the-art. Journal of Imaging 7.
Marcinkiewicz M, Nalepa J, Lorenzo PR, Dudzik W, Mrukwa G (2019). Segmenting Brain Tumors from MRI Using Cascaded Multi-modal U-Nets. In: Brainlesion:Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries. BrainLes 2018.Lecture Notes in Computer Science, vol. 2. Springer, Cham.
Mastromichalakis S (2020). Alrelu: A different approach on leaky relu activation function to improve neural networks performance. ArXiv abs/2012.07564.
McKinley R, Meier R, Wiest R (2019). Ensembles of Densely-Connected CNNs with Label-Uncertainty for Brain Tumor Segmentation. In: Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries. BrainLes 2018. Lecture Notes in Computer Science, vol. 2. Springer, Cham.
McKinley R, Rebsamen M, Meier R, Wiest R (2020). Triplanar ensemble of 3d-to2d cnns with label-uncertainty for brain tumor segmentation. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11992 LNCS. Springer International Publishing, 379–87.
Menze BH, Jakab A, Bauer S, Kalpathy-Cramer J, Farahani K, Kirby J, al E (2015). The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS). IEEE Transactions on Medical Imaging 34:1993–2024.
Minaee S, Boykov YY, Porikli F, Plaza AJ, Kehtarnavaz N, Terzopoulos D (2021).Image Segmentation Using Deep Learning: A Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence 8828:1–.
Moini J, Piran P (2020). Chapter 1 - histophysiology. In: Functional and Clinical Neuroanatomy. Academic Press, 1–49.
Myronenko A (2019). 3D MRI Brain Tumor Segmentation. In: Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries. BrainLes 2018. Lecture Notes in Computer Science. Springer, Cham.
Nimeesha KM, Gowda RM (2015). Brain Tumour Segmentation Using K-Means And Fuzzy C-Means Clustering Algorithm. International Journal of Computer Science and Information Technology Research :1–6.
Pal KK, Sudeep KS (2016). Preprocessing for image classification by convolutional neural networks. In: 2016 IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology (RTEICT). IEEE.
Rajan JK, Shahil DFD, Elakkiya MT, Prasad R (2017). Image Segmentation Using SVM Pixel Classification. International Journal of Advanced Research in Basic Engineering Sciences and Technology IJARBEST 3:45–51.
Recht LD, Bernstein M (1995). Low-Grade Gliomas. Neurologic Clinics 13:847–59.
Reinhold JC, Dewey BE, Carass A, Prince JL (2018). Evaluating the impact of intensity normalization on mr image synthesis. Proceedings of SPIE the International Society for Optical Engineering 10949.
Rizwan I Haque I, Neubert J (2020). Deep learning approaches to biomedical image segmentation. Informatics in Medicine Unlocked 18:100297.
Ronneberger O, Fischer P, Brox T (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation. IEEE Access 9:16591–603.
Rui Hua, Huo Q, Gao Y, Sun Y, Shi F (2019). Multimodal Brain Tumor Segmentation Using Cascaded V-Nets. In: Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries. BrainLes 2018. Lecture Notes in Computer Science, vol.11384. Springer, Cham.
Sharma N, Ray A, Shukla K, Sharma S, Pradhan S, Srivastva A, Aggarwal L (2010).Automated medical image segmentation techniques. Journal of Medical Physics 35:3.
Small H, Ventura J (2017). Handling Unbalanced Data in Deep Image Segmentation.
Taha AA, Hanbury A (2015). Metrics for evaluating 3D medical image segmentation:analysis, selection, and tool. BMC Medical Imaging 15:29.
Wang G, Li W, Ourselin S, Vercauteren T (2017). Automatic Brain Tumor Segmentation using Cascaded Anisotropic Convolutional Neural Networks. In: Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries. BrainLes 2017. Lecture Notes in Computer Science.
Wang G, Li W, Ourselin S, Vercauteren T (2019). Automatic brain tumor segmentation using convolutional neural networks with test-time augmentation. In: Brainlesion:Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries. BrainLes 2018.Lecture Notes in Computer Science, vol. 11384 LNCS.
Wasule V, Poonam S (2017). Classification of Brain MRI Using SVM and KNN Classifier. In: 2017 Third International Conference on Sensing, Signal Processing and Security (ICSSS).
Wen L, Jia F, Hu Q (2015). Automatic Segmentation of Liver Tumor in CT Images with Deep Convolutional Neural Networks. Journal of Computer and Communications 03:146–51.
Weninger L, Rippel O, Koppers S, Merhof D (2019). Segmentation of Brain Tumors and Patient Survival Prediction: Methods for the BraTS 2018 Challenge. In: Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries. BrainLes 2018. Lecture Notes in Computer Science, vol. 11384. Cham: Springer International Publishing.
Withey D, Koles Z (2007). Medical Image Segmentation: Methods and Software. In: Joint Meeting of the 6th International Symposium on Noninvasive Functional Source Imaging of the Brain and Heart and the International Conference on Functional
Biomedical Imaging, vol. 112. IEEE.
Zawish M, Siyal AA, Shahzad HS, Junejo AZ, Aiman K (2019). Brain Tumor Segmentation through Region-based, Supervised and Unsupervised Learning Methods: A Literature Survey Brain Tumor Segmentation through Image Processing Methods: A Literature Survey. In: Journal of Biomedical Engineering and Medical
Imaging, vol. 6.
Zhang TC, Yang J, Zhang JP (2016). SVM Methods in Image Segmentation. In: Proceedings of the 6th International Conference on Advanced Collaborative Networks, Systems and Applications, IARIA, no. c.
Zhao YX, Zhang YM, Liu CL (2020). Bag of Tricks for 3D MRI Brain Tumor
Segmentation. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11992LNCS. Springer International Publishing, 210–20.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Yamina Azzi, Abdelouahab Moussaoui , Mohand-Tahar Kechadi
This work is licensed under a Creative Commons Attribution 4.0 International License.
