Comparison of Hyperparameter Optimization Techniques in Hybrid CNN-LSTM Model for Heart Disease Classification
DOI:
10.33395/sinkron.v9i1.13219Keywords:
Heart Disease, Machine Learning, Deep Learning, Classification, Hyperparameter OptimizationAbstract
Heart disease, which causes the highest number of deaths worldwide, recorded about 17.9 million cases in 2019, or about 32% of total global deaths, according to the World Health Organization (WHO). The significance of early detection of heart disease drives research to develop effective diagnosis systems utilizing machine learning. The advancement of machine learning in healthcare currently primarily serves as a supporting role in the ability of clinicians or analysts to fulfill their roles, identify healthcare trends, and develop disease prediction models. Meanwhile, deep learning has experienced rapid development and has become the most popular method in recent years, one of which is detecting diseases. The main objective of this research is to optimize the hybrid convolutional neural network (CNN) and long short-term memory (LSTM) model for classifying heart disease by comparing hyperparameter optimization using grid search and random search. Although random search requires less time in hyperparameter tuning, the classification performance results of grid search show higher accuracy. In the test, the hybrid CNN and LSTM model with grid search achieved 91.67% accuracy, 89.66% recall (sensitivity), 93.55% specificity, 92.86% precision, 91.23% f1-score, and 0.9310 AUC value. These results confirm that using a hybrid CNN and LSTM model with a grid search approach is better suited for classifying heart disease.
Downloads
References
Ali, Y. A., Awwad, E. M., Al-Razgan, M., & Maarouf, A. (2023). Hyperparameter Search for Machine Learning Algorithms for Optimizing the Computational Complexity. Processes, 11(2). https://doi.org/10.3390/pr11020349
Alzubaidi, L., Zhang, J., Humaidi, A. J., Al-Dujaili, A., Duan, Y., Al-Shamma, O., Santamaría, J., Fadhel, M. A., Al-Amidie, M., & Farhan, L. (2021). Review of deep learning: concepts, CNN architectures, challenges, applications, future directions. Journal of Big Data, 8(1). https://doi.org/10.1186/s40537-021-00444-8
Anggraini Susanti, L., Soleh, A. M., Sartono, B., Pertanian Bogor, I., & Korespondensi, P. (2023). DEEP LEARNING IMAGE CLASSIFICATION RONTGEN DADA PADA KASUS COVID-19 MENGGUNAKAN ALGORITMA CONVOLUTIONAL NEURAL NETWORK. Jurnal Teknologi Informasi Dan Ilmu Komputer (JTIIK), 10. https://doi.org/10.25126/jtiik.2023107142
Arooj, S., Rehman, S. ur, Imran, A., Almuhaimeed, A., Alzahrani, A. K., & Alzahrani, A. (2022). A Deep Convolutional Neural Network for the Early Detection of Heart Disease. Biomedicines, 10(11). https://doi.org/10.3390/biomedicines10112796
Cardiovascular diseases (CVDs). (2021, June 11). https://www.who.int/news-room/fact-sheets/detail/cardiovascular-diseases-(cvds)
Gneiting, T., & Walz, E. M. (2022). Receiver operating characteristic (ROC) movies, universal ROC (UROC) curves, and coefficient of predictive ability (CPA). Machine Learning, 111(8), 2769–2797. https://doi.org/10.1007/s10994-021-06114-3
Gunawan, M. I., Sugiarto, D., & Mardianto, I. (2020). JEPIN (Jurnal Edukasi dan Penelitian Informatika) Peningkatan Kinerja Akurasi Prediksi Penyakit Diabetes Mellitus Menggunakan Metode Grid Seacrh pada Algoritma Logistic Regression. JEPIN (Jurnal Edukasi Dan Penelitian Informatika), 6.
Habehh, H., & Gohel, S. (2021). Machine Learning in Healthcare. Current Genomics, 22(4), 291–300. https://doi.org/10.2174/1389202922666210705124359
Janosi, A., Steinbrunn, W., Pfisterer, M., & Detrano, R. (1988, June 30). Heart Disease. UCI Machine Learning Repository.
Javid, I., Khalaf, A., Alsaedi, Z., & Ghazali, R. (2020). Enhanced Accuracy of Heart Disease Prediction using Machine Learning and Recurrent Neural Networks Ensemble Majority Voting Method. In IJACSA) International Journal of Advanced Computer Science and Applications (Vol. 11, Issue 3). www.ijacsa.thesai.org
Joseph, V. R., & Vakayil, A. (2022). SPlit: An Optimal Method for Data Splitting. Technometrics, 64(2), 166–176. https://doi.org/10.1080/00401706.2021.1921037
Lee, S. J., Lee, S. H., Choi, H. I., Lee, J. Y., Jeong, Y. W., Kang, D. R., & Sung, K. C. (2022). Deep Learning Improves Prediction of Cardiovascular Disease-Related Mortality and Admission in Patients with Hypertension: Analysis of the Korean National Health Information Database. Journal of Clinical Medicine, 11(22). https://doi.org/10.3390/jcm11226677
Louridi, N., Douzi, S., & El Ouahidi, B. (2021). Machine learning-based identification of patients with a cardiovascular defect. Journal of Big Data, 8(1). https://doi.org/10.1186/s40537-021-00524-9
Mienye, I. D., & Sun, Y. (2021). Improved heart disease prediction using particle swarm optimization based stacked sparse autoencoder. Electronics (Switzerland), 10(19). https://doi.org/10.3390/electronics10192347
Mohan, S., Thirumalai, C., & Srivastava, G. (2019). Effective heart disease prediction using hybrid machine learning techniques. IEEE Access, 7, 81542–81554. https://doi.org/10.1109/ACCESS.2019.2923707
Mustajab, R. (2023, September 29). Kematian akibat Penyakit Jantung di Indonesia Terus Meningkat. https://dataindonesia.id/kesehatan/detail/kematian-akibat-penyakit-jantung-di-indonesia-terus-meningkat
Obayya, M., Alsamri, J. M., Al-Hagery, M. A., Mohammed, A., & Hamza, M. A. (2023). Automated Cardiovascular Disease Diagnosis Using Honey Badger Optimization with Modified Deep Learning Model. IEEE Access, 11, 64272–64281. https://doi.org/10.1109/ACCESS.2023.3286661
Shankar, V. V., Kumar, V., Devagade, U., Karanth, V., & Rohitaksha, K. (2020). Heart Disease Prediction Using CNN Algorithm. SN Computer Science, 1(3). https://doi.org/10.1007/s42979-020-0097-6
Shrivastava, P. K., Sharma, M., sharma, P., & Kumar, A. (2023). HCBiLSTM: A hybrid model for predicting heart disease using CNN and BiLSTM algorithms. Measurement: Sensors, 25. https://doi.org/10.1016/j.measen.2022.100657
Sudha, V. K., & Kumar, D. (2023). Hybrid CNN and LSTM Network For Heart Disease Prediction. SN Computer Science, 4(2). https://doi.org/10.1007/s42979-022-01598-9
Sunarya, U., & Haryanti, T. (2022). Perbandingan Kinerja Algoritma Optimasi pada Metode Random Forest untuk Deteksi Kegagalan Jantung. Jurnal Rekayasa Elektrika, 18(4). https://doi.org/10.17529/jre.v18i4.26981
Van Houdt, G., Mosquera, C., & Nápoles, G. (2020). A review on the long short-term memory model. Artificial Intelligence Review, 53(8), 5929–5955. https://doi.org/10.1007/s10462-020-09838-1
Wiharto, Suryani, E., Setyawan, S., & Putra, B. P. (2022). The Cost-Based Feature Selection Model for Coronary Heart Disease Diagnosis System Using Deep Neural Network. IEEE Access, 10, 29687–29697. https://doi.org/10.1109/ACCESS.2022.3158752
Wresti, Gunawan, Purwanto, & Catur Supriyanto. (2022). Comparison of Grid Search and Evolutionary Parameter Optimization with Neural Networks on JCI Stock Price Movements during the Covid 19. Jurnal RESTI (Rekayasa Sistem Dan Teknologi Informasi), 6(6), 1079–1087. https://doi.org/10.29207/resti.v6i6.4402
Yang, L., & Shami, A. (2020). On hyperparameter optimization of machine learning algorithms: Theory and practice. Neurocomputing, 415, 295–316. https://doi.org/10.1016/j.neucom.2020.07.061
Downloads
|
How to Cite
Issue
Section
License
Copyright (c) 2023 Ahmad Alaik Maulani, Sri Winarno, Junta Zeniarja, Ailsa Nurina Cahyani, Rusyda Tsania Eka Putri
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Muhammad Khoiruddin harahap
Google Scholar 
Moraref
PKP Index
Garuda Kemdikbud
Indonesia OneSearch
OCLC Worldcat
Dimensions
Index Copernicus
Scilit
