Predicting Thyroid Disease using Optimized Multi-Layered Long Short-Term Memory (LSTM) Neural Network with Residual Attention Mechanism

Predicting Thyroid Disease using Optimized Multi-Layered Long Short-Term Memory (LSTM) Neural Network with Residual Attention Mechanism

  IJETT-book-cover           
  
© 2023 by IJETT Journal
Volume-71 Issue-7
Year of Publication : 2023
Author : R. Nagalakshmi, R. Priya
DOI : 10.14445/22315381/IJETT-V71I7P208

How to Cite?

R. Nagalakshmi, R. Priya, "Predicting Thyroid Disease using Optimized Multi-Layered Long Short-Term Memory (LSTM) Neural Network with Residual Attention Mechanism," International Journal of Engineering Trends and Technology, vol. 71, no. 7, pp. 75-84, 2023. Crossref, https://doi.org/10.14445/22315381/IJETT-V71I7P208

Abstract
Thyroid disease is a common ailment that arises when the thyroid gland produces an inadequate amount of thyroid hormone. The challenge in diagnosing thyroid disease is that its symptoms resemble those of other conditions, making it difficult to detect. One of the most effective ways to diagnose thyroid problems is through blood tests, which measure the amount of thyroid hormones in the bloodstream. However, interpreting the complex data generated by these tests can be challenging. Early detection of thyroid issues is crucial to prevent complications and reduce mortality rates. To improve decision-making systems, medical data mining is increasingly using deep learning models. This study proposes a novel stacked residual long-short memory architecture (SR-LSTM) with an attention mechanism for predicting thyroid disease. The model employs an attention mechanism and layer stacking to enhance the accuracy of prediction. Additionally, this work is optimized using the Giant Trevally Optimizer (GTO) metaheuristic optimization algorithm. The performance results of the proposed model achieve outstanding performance in precision, recall, F1, and accuracy, with scores of 99.836%, 99.839%, 99.837%, and 99.931% than traditional methods.

Keywords
Thyroid, GTO, LSTM, Prediction.

References
[1] Ling Chen et al., “Mining Health Examination Records—A Graph-Based Approach,” IEEE Transactions on Knowledge and Data Engineering, vol. 28, no. 9, pp. 2423-2437, 2016.
[CrossRef] [Google Scholar] [Publisher Link]
[2] Feyzullah Temurtas, “A Comparative Study on Thyroid Disease Diagnosis Using Neural Networks,” Expert Systems with Applications, vol. 36, no. 1, pp. 944–949, 2009.
[CrossRef] [Google Scholar] [Publisher Link]
[3] Fabrizio Monaco, “Classification of Thyroid Diseases: Suggestions for a Revision,” The Journal of Clinical Endocrinology & Metabolism, vol. 88, no. 4, pp. 1428–142, 2003.
[CrossRef] [Google Scholar] [Publisher Link]
[4] Amulya.R. Rao, and B.S. Renuka, "A Machine Learning Approach To Predict Thyroid Disease At Early Stages of Diagnosis," 2020 IEEE International Conference for Innovation in Technology (INOCON), pp. 1-4, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[5] Ankita Tyagi, Ritika Mehra, and Aditya Saxena, "Interactive Thyroid Disease Prediction System Using Machine Learning Technique," 2018 Fifth International Conference on Parallel, Distributed and Grid Computing (PDGC), pp. 689-693, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[6] D. Priyadharsini and S. Sasikala, "Efficient Thyroid Disease Prediction Using Features Selection and Meta-Classifiers," 2022 6th International Conference on Computing Methodologies and Communication (ICCMC), pp. 1236-1243, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[7] Muntadher Alsaadawi, and Eftal Şehirli, "The Efficiency of Ensemble Techniques in Predicting Thyroid Disorder: A Comparative Study," 2022 International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT), pp. 834-840, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[8] Sefer KURNAZ et al., "A High Efficiency Thyroid Disorders Prediction System with Non-Dominated Sorting Genetic Algorithm NSGA-II as a Feature Selection Algorithm," 2020 International Conference for Emerging Technology (INCET), pp. 1-6, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[9] Mejdi Karmeni et al., "Towards an Accurate Stacked Ensemble Learning Model for Thyroid Earlier Detection," 2022 IEEE/ACS 19th International Conference on Computer Systems and Applications (AICCSA), pp. 1-8, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[10] Ying An et al., "High-Risk Prediction of Cardiovascular Diseases Via Attention-Based Deep Neural Networks," IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 18, no. 3, pp. 1093-1105, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[11] Y. An, K. Tang and J. Wang, "Time-Aware Multi-Type Data Fusion Representation Learning Framework for Risk Prediction of Cardiovascular Diseases," IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 19, no. 6, pp. 3725-3734, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[12] Shuai Zheng et al., "Multi-Modal Graph Learning for Disease Prediction," IEEE Transactions on Medical Imaging, vol. 41, no. 9, pp. 2207-2216, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[13] Guoxian Yu et al., "Deepida: Predicting Isoform-Disease Associations by Data Fusion and Deep Neural Networks," IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 19, no. 4, pp. 2166-2176, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[14] Yang Shen et al., "Ensdeepdp: An Ensemble Deep Learning Approach for Disease Prediction through Metagenomics," IEEE/ACM Transactions on Computational Biology and Bioinformatics, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[15] Xingyi Li et al., "A Dual Ranking Algorithm Based on the Multiplex Network for Heterogeneous Complex Disease Analysis," IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 19, no. 4, pp. 1993-2002, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[16] Xianli Zhang et al., "Context-Aware and Time-Aware Attention-Based Model for Disease Risk Prediction with Interpretability," IEEE Transactions on Knowledge and Data Engineering, vol. 35, no. 4, pp. 3551-3562.
[CrossRef] [Google Scholar] [Publisher Link]
[17] Kirubha.M et al., "Analysis of Thyroid Disease Using K Means and Fuzzy C Means Algorithm," SSRG International Journal of Computer Science and Engineering, vol. 6, no. 10, pp. 1-6, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[18] Qiao Ning et al., "SSKM_Succ: A Novel Succinylation Sites Prediction Method Incorporating K-Means Clustering with a New Semi-Supervised Learning Algorithm," IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 19, no. 1, pp. 643-652, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[19] Klaus Greff et al., “LSTM: A Search Space Odyssey,” IEEE Trans Neural Networks Learn Systems, vol. 28, no. 10, pp. 2222-2232, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[20] Raniah Zaheer, and Humera Shaziya, “A Study of the Optimization Algorithms in Deep Learning,” 2019 Third International Conference on Inventive Systems and Control (ICISC), pp. 536-539, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[21] Haval Tariq Sadeeq, and Adnan Mohsin Abdulazeez, "Giant Trevally Optimizer (GTO): A Novel Metaheuristic Algorithm for Global Optimization and Challenging Engineering Problems,” IEEE Access, vol. 10, pp. 121615-121640, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[22] Pei Liu et al., "Optimizing Survival Analysis of Xgboost for Ties to Predict Disease Progression of Breast Cancer," IEEE Transactions on Biomedical Engineering, vol. 68, no. 1, pp. 148-160, 2021.
[CrossRef] [Google Scholar] [Publisher Link]