Deep Learning-Based Hippocampal Segmentation and MTA Classification Using U-Net with ResNet-50 Backbone
Downloads
Medial Temporal Atrophy (MTA) is a key biomarker in the early diagnosis of dementia. However, its assessment through manual inspection of MRI scans is subjective, time-consuming, and prone to inter-observer variability. This creates the need for automated systems that can provide accurate, consistent, and clinically interpretable evaluations. This study aims to develop a hybrid deep learning framework that integrates U-Net with a ResNet-50 backbone for simultaneous hippocampal segmentation and MTA grading, thereby reducing diagnostic subjectivity and bridging the gap between image processing and clinical interpretation. The main contribution of this work lies in the dual functionality of the proposed architecture: not only producing precise segmentation masks of the hippocampal region but also classifying the degree of atrophy into MTA scores (0–4), which previous studies on hippocampal segmentation have not addressed. The proposed method employs a U-Net for pixel-level segmentation, enhanced with a ResNet-50 backbone to stabilize gradient propagation and enrich feature representation during encoding. Results demonstrated excellent performance, achieving a training accuracy of 99.9% with strong convergence between training and validation curves. On a test set of 32 coronal MRI slices, the model correctly classified 26 samples, misclassifying only 6. Overall, the proposed U-Net with ResNet-50 backbone provides an accurate and reliable end-to-end solution for hippocampal segmentation and MTA grading. Its clinical performance demonstrates parity with expert radiologists, underscoring its potential as a decision-support tool in dementia diagnosis. Future work will focus on extending this framework to 3D U-Net architectures, enabling the integration of volumetric MRI features to enhance robustness and generalizability across diverse datasets further
[1] S. Nugraha et al., “Knowledge about Dementia and its Associated Factors: Study among the Middle-aged Population in Indonesia,” Open Access Maced J Med Sci, vol. 10, no. E, pp. 783–789, May 2022, doi: 10.3889/oamjms.2022.8892.
[2] S. V. Birajdar, M. Mulchandani, F. Mazahir, and A. K. Yadav, “Dementia and neurodegenerative disorder: An introduction,” in Nanomedicine-Based Approaches for the Treatment of Dementia, Elsevier, 2023, pp. 1–36. doi: 10.1016/B978-0-12-824331-2.00007-8.
[3] Y. L. Rao, B. Ganaraja, B. V. Murlimanju, T. Joy, A. Krishnamurthy, and A. Agrawal, “Hippocampus and its involvement in Alzheimer’s disease: a review,” 3 Biotech, vol. 12, no. 2, p. 55, Feb. 2022, doi: 10.1007/s13205-022-03123-4.
[4] S. Ribarič, “Detecting Early Cognitive Decline in Alzheimer’s Disease with Brain Synaptic Structural and Functional Evaluation,” Biomedicines, vol. 11, no. 2, p. 355, Jan. 2023, doi: 10.3390/biomedicines11020355.
[5] A. Brown et al., “Measuring the quality of life of family carers of people with dementia: development and validation of C-DEMQOL,” Quality of Life Research, vol. 28, no. 8, pp. 2299–2310, Aug. 2019, doi: 10.1007/s11136-019-02186-w.
[6] A. Molinder, D. Ziegelitz, S. E. Maier, and C. Eckerström, “Validity and reliability of the medial temporal lobe atrophy scale in a memory clinic population,” BMC Neurol, vol. 21, no. 1, p. 289, Dec. 2021, doi: 10.1186/s12883-021-02325-2.
[7] E. S. C. Korf, L.-O. Wahlund, P. J. Visser, and P. Scheltens, “Medial temporal lobe atrophy on MRI predicts dementia in patients with mild cognitive impairment,” Neurology, vol. 63, no. 1, pp. 94–100, Jul. 2004, doi: 10.1212/01.WNL.0000133114.92694.93.
[8] A. Rau and H. Urbach, “The MTA score—simple and reliable, the best for now?,” Eur Radiol, vol. 31, no. 12, pp. 9057–9059, Dec. 2021, doi: 10.1007/s00330-021-08340-8.
[9] G. Cipriani, S. Danti, L. Picchi, A. Nuti, and M. Di Fiorino, “Daily functioning and dementia,” Dement Neuropsychol, vol. 14, no. 2, pp. 93–102, Jun. 2020, doi: 10.1590/1980-57642020dn14-020001.
[10] E. Nichols et al., “Estimation of the global prevalence of dementia in 2019 and forecasted prevalence in 2050: an analysis for the Global Burden of Disease Study 2019,” Lancet Public Health, vol. 7, no. 2, pp. e105–e125, Feb. 2022, doi: 10.1016/S2468-2667(21)00249-8.
[11] E. J. W. Van Someren et al., “Medial temporal lobe atrophy relates more strongly to sleep-wake rhythm fragmentation than to age or any other known risk,” Neurobiol Learn Mem, vol. 160, pp. 132–138, Apr. 2019, doi: 10.1016/j.nlm.2018.05.017.
[12] N. R. D. Cahyo, C. A. Sari, E. H. Rachmawanto, C. Jatmoko, R. R. A. Al-Jawry, and M. A. Alkhafaji, “A Comparison of Multi Class Support Vector Machine vs Deep Convolutional Neural Network for Brain Tumor Classification,” in 2023 International Seminar on Application for Technology of Information and Communication (iSemantic), IEEE, Sep. 2023, pp. 358–363. doi: 10.1109/iSemantic59612.2023.10295336.
[13] M. Tsuneki, “Deep learning models in medical image analysis,” J Oral Biosci, vol. 64, no. 3, pp. 312–320, Sep. 2022, doi: 10.1016/j.job.2022.03.003.
[14] P. Subarkah, W. R. Damayanti, and R. A. Permana, “Comparison of Correlated Algorithm Accuracy Naive Bayes Classifier and Naive Bayes Classifier for Classification of heart failure,” ILKOM Jurnal Ilmiah, vol. 14, no. 2, pp. 120–125, Aug. 2022, doi: 10.33096/ilkom.v14i2.1148.120-125.
[15] L. A. M. Zaki et al., “Comparing two artificial intelligence software packages for normative brain volumetry in memory clinic imaging,” Neuroradiology, vol. 64, no. 7, pp. 1359–1366, Jul. 2022, doi: 10.1007/s00234-022-02898-w.
[16] R. A. Hazarika, A. K. Maji, R. Syiem, S. N. Sur, and D. Kandar, “Hippocampus Segmentation Using U-Net Convolutional Network from Brain Magnetic Resonance Imaging (MRI),” J Digit Imaging, vol. 35, no. 4, pp. 893–909, Aug. 2022, doi: 10.1007/s10278-022-00613-y.
[17] N. Sohail and S. M. Anwar, “A Modified U-Net Based Framework for Automated Segmentation of Hippocampus Region in Brain MRI,” IEEE Access, vol. 10, pp. 31201–31209, 2022, doi: 10.1109/ACCESS.2022.3159618.
[18] Q. Yang, C. Wang, K. Pan, B. Xia, R. Xie, and J. Shi, “An improved 3D-UNet-based brain hippocampus segmentation model based on MR images,” BMC Med Imaging, vol. 24, no. 1, p. 166, Jul. 2024, doi: 10.1186/s12880-024-01346-w.
[19] N. R. D. Cahyo and M. M. I. Al-Ghiffary, “An Image Processing Study: Image Enhancement, Image Segmentation, and Image Classification using Milkfish Freshness Images,” IJECAR) International Journal of Engineering Computing Advanced Research, vol. 1, no. 1, pp. 11–22, 2024.
[20] I. P. Kamila, C. A. Sari, E. H. Rachmawanto, and N. R. D. Cahyo, “A Good Evaluation Based on Confusion Matrix for Lung Diseases Classification using Convolutional Neural Networks,” Advance Sustainable Science, Engineering and Technology, vol. 6, no. 1, p. 0240102, Dec. 2023, doi: 10.26877/asset.v6i1.17330.
[21] M. M. I. Al-Ghiffary, N. R. D. Cahyo, E. H. Rachmawanto, C. Irawan, and N. Hendriyanto, “Adaptive deep learning based on FaceNet convolutional neural network for facial expression recognition,” Journal of Soft Computing, vol. 05, no. 03, pp. 271–280, 2024, doi: https://doi.org/10.52465/joscex.v5i3.450.
[22] A. Susanto, I. U. W. Mulyono, C. A. Sari, E. H. Rachmawanto, D. R. I. M. Setiadi, and M. K. Sarker, “Handwritten Javanese script recognition method based 12-layers deep convolutional neural network and data augmentation,” IAES International Journal of Artificial Intelligence, vol. 12, no. 3, pp. 1448–1458, Sep. 2023, doi: 10.11591/ijai.v12.i3.pp1448-1458.
[23] A. Abedalla, M. Abdullah, M. Al-Ayyoub, and E. Benkhelifa, “Chest X-ray pneumothorax segmentation using U-Net with EfficientNet and ResNet architectures,” PeerJ Comput Sci, vol. 7, p. e607, Jun. 2021, doi: 10.7717/peerj-cs.607.
[24] A. Salas-Espinales, E. Vélez-Chávez, R. Vázquez-Martín, A. García-Cerezo, and A. Mandow, “U-Net/ResNet-50 Network with Transfer Learning for Semantic Segmentation in Search and Rescue,” 2024, pp. 244–255. doi: 10.1007/978-3-031-59167-9_21.
[25] J. Zhu, R. Zhang, and H. Zhang, “An MRI brain tumor segmentation method based on improved U-Net,” Mathematical Biosciences and Engineering, vol. 21, no. 1, pp. 778–791, 2023, doi: 10.3934/mbe.2024033.
[26] M. M. I. Al-Ghiffary, C. A. Sari, E. H. Rachmawanto, N. M. Yacoob, N. R. D. Cahyo, and R. R. Ali, “Milkfish Freshness Classification Using Convolutional Neural Networks Based on Resnet50 Architecture,” Advance Sustainable Science Engineering and Technology, vol. 5, no. 3, p. 0230304, Oct. 2023, doi: 10.26877/asset.v5i3.17017.
[27] D. Kilichev and W. Kim, “Hyperparameter Optimization for 1D-CNN-Based Network Intrusion Detection Using GA and PSO,” Mathematics, vol. 11, no. 17, Sep. 2023, doi: 10.3390/math11173724.
[28] L. Liao, H. Li, W. Shang, and L. Ma, “An Empirical Study of the Impact of Hyperparameter Tuning and Model Optimization on the Performance Properties of Deep Neural Networks,” ACM Transactions on Software Engineering and Methodology, vol. 31, no. 3, pp. 1–40, Jul. 2022, doi: 10.1145/3506695.
[29] M. Heydarian, T. E. Doyle, and R. Samavi, “MLCM: Multi-Label Confusion Matrix,” IEEE Access, vol. 10, pp. 19083–19095, 2022, doi: 10.1109/ACCESS.2022.3151048.
[30] I. Markoulidakis and G. Markoulidakis, “Probabilistic Confusion Matrix: A Novel Method for Machine Learning Algorithm Generalized Performance Analysis,” Technologies (Basel), vol. 12, no. 7, p. 113, Jul. 2024, doi: 10.3390/technologies12070113.
Copyright (c) 2025 Aldienannisa Devin Salsabila, Fatimah Fatimah, Darmini Darmini, Selamet Budi Kurniawan (Author)

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlikel 4.0 International (CC BY-SA 4.0) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).





