Assessing the Performance of Logistic Regression in Heart Disease Detection through 5-Fold Cross-Validation

Authors

  • Huzain Azis Universitas Kuala Lumpur

DOI:

https://doi.org/10.56705/ijaimi.v2i1.137

Keywords:

Logistic Regression, Heart Disease Prediction, Machine Learning, Medical Diagnostics, 5-Fold Cross-Validation, Model Reliability

Abstract

This study explores the effectiveness of Logistic Regression in predicting heart disease using a dataset derived from multiple international databases. Employing a 5-fold cross-validation method, the research aimed to evaluate the model's accuracy, precision, recall, and F1-score. Results indicated that Logistic Regression performs robustly, with accuracy ranging from 80% to 88.29%, and high recall rates, highlighting its potential as a valuable tool in medical diagnostics. Despite some variability in precision, which may lead to higher false positive rates, the model's high recall is crucial in clinical settings where missing a diagnosis can have dire consequences. The research confirmed the applicability of Logistic Regression to binary classification problems in healthcare, aligning with existing literature that supports its use in similar contexts. The study contributes to the field by demonstrating the model's consistency and reliability across diverse data subsets, reinforcing the potential for machine learning applications in healthcare diagnostics. Future research should focus on integrating Logistic Regression with other models to improve accuracy and testing the model on more current, varied datasets to enhance its generalizability and effectiveness in real-world settings.

References

S. Rahmah, H. Azis, D. Widyawati, and A. U. Tenripada, “Prediksi potensi donatur menggunakan model Logistic Regression,” Indones. J. Data Sci., vol. 4, no. 1, pp. 31–37, 2023.

F. T. Admojo and B. S. W. Poetro, “Comparative Study on the Performance of the Bagging Algorithm in the Breast Cancer Dataset,” … Artif. Intell. Med. …, 2023, [Online]. Available: https://www.jurnal.yoctobrain.org/index.php/ijaimi/article/view/87.

A. Maulidinnawati, “Classification Optimization of Skin Cancer Using the Adaboost Algorithm,” … J. Artif. Intell. Med. …, 2023, [Online]. Available: https://www.jurnal.yoctobrain.org/index.php/ijaimi/article/view/86.

A. Naswin and A. P. Wibowo, “Performance Analysis of the Decision Tree Classification Algorithm on the Pneumonia Dataset,” … Artif. Intell. Med. …, 2023, [Online]. Available: https://jurnal.yoctobrain.org/index.php/ijaimi/article/view/83.

T. E. Tarigan, E. Susanti, M. I. Siami, I. Arfiani, and ..., “Performance Metrics of AdaBoost and Random Forest in Multi-Class Eye Disease Identification: An Imbalanced Dataset Approach,” … Artif. Intell. …, 2023, [Online]. Available: https://jurnal.yoctobrain.org/index.php/ijaimi/article/view/98.

G. Giri, I. A. Musdar, H. Angriani, and ..., “Enhancing Disease Management in Mango Cultivation: A Machine Learning Approach to Classifying Leaf Diseases,” Indones. J. …, 2023, [Online]. Available: https://www.jurnal.yoctobrain.org/index.php/ijodas/article/view/111.

M. I. J. Putra and V. Alexander, “Comparison of Machine Learning Land Use-Land Cover Supervised Classifiers Performance on Satellite Imagery Sentinel 2 using Lazy Predict Library,” Indones. J. Data …, 2023, [Online]. Available: https://www.jurnal.yoctobrain.org/index.php/ijodas/article/view/102.

C. D. Suhendra, E. Najwaini, E. Maria, and ..., “A Machine Learning Perspective on Daisy and Dandelion Classification: Gaussian Naive Bayes with Sobel,” Indones. J. …, 2023, [Online]. Available: https://jurnal.yoctobrain.org/index.php/ijodas/article/view/112.

N. Rismayanti and A. P. Utami, “Improving Multi-Class Classification on 5-Celebrity-Faces Dataset using Ensemble Classification Methods,” Indones. J. Data …, 2023, [Online]. Available: https://www.jurnal.yoctobrain.org/index.php/ijodas/article/view/78.

H. A. Siregar, M. Z. Raditya, A. N. Yesa, and ..., “Comparison of Classification Algorithm Performance for Diabetes Prediction Using Orange Data Mining,” Indones. J. …, 2023, [Online]. Available: https://jurnal.yoctobrain.org/index.php/ijodas/article/view/103.

D. Ratnasari, “Comparison of Performance of Four Distance Metric Algorithms in K-Nearest Neighbor Method on Diabetes Patient Data,” Indones. J. Data Sci., 2023, [Online]. Available: https://www.jurnal.yoctobrain.org/index.php/ijodas/article/view/71.

H. Azis, F. Fattah, and P. Putri, “Performa Klasifikasi K-NN dan Cross-validation pada Data Pasien Pengidap Penyakit Jantung,” Ilk. J. Ilm., vol. 12, no. 2, pp. 81–86, 2020, [Online]. Available: file:///Users/kbh/Downloads/507-2012-5-PB.pdf.

H. Azis, F. T. Admojo, and E. Susanti, “Analisis Perbandingan Performa Metode Klasifikasi pada Dataset Multiclass Citra Busur Panah,” Techno.Com, vol. 19, no. 3, 2020, [Online]. Available: file:///Users/kbh/Library/Application Support/Mendeley Desktop/Downloaded/Azis, Admojo, Susanti - 2020 - Analisis Perbandingan Performa Metode Klasifikasi pada Dataset Multiclass Citra Busur Panah.pdf.

H. Azis, D. Widyawati, and ..., “Prediksi potensi donatur menggunakan model Logistic Regression,” Indones. J. …, 2023, [Online]. Available: https://jurnal.yoctobrain.org/index.php/ijodas/article/view/64.

L. S. Van Velzen, “Classification of suicidal thoughts and behaviour in children: results from penalised logistic regression analyses in the Adolescent Brain Cognitive Development study,” Br. J. Psychiatry, vol. 220, no. 4, pp. 210–218, 2022, doi: 10.1192/bjp.2022.7.

Y. Zhang, “Multi-label feature selection based on logistic regression and manifold learning,” Appl. Intell., vol. 52, no. 8, pp. 9256–9273, 2022, doi: 10.1007/s10489-021-03008-8.

B. H. Reddy, “Classification of Fire and Smoke Images using Decision Tree Algorithm in Comparison with Logistic Regression to Measure Accuracy, Precision, Recall, F-score,” 14th International Conference on Mathematics, Actuarial Science, Computer Science and Statistics, MACS 2022. 2022, doi: 10.1109/MACS56771.2022.10022449.

H. Oumarou and N. Rismayanti, “Automated Classification of Empon Plants: A Comparative Study Using Hu Moments and K-NN Algorithm,” Indones. J. Data …, 2023, [Online]. Available: https://jurnal.yoctobrain.org/index.php/ijodas/article/view/115.

M. A. Asis, M. A. Mude, and R. Astiani, “Shortest Route Navigation Indoors Using Digital Maps,” … J. Data Sci., 2023, [Online]. Available: https://www.jurnal.yoctobrain.org/index.php/ijodas/article/view/110.

U. Zaky, A. Naswin, S. Sumiyatun, and ..., “Performance Analysis of the Decision Tree Classification Algorithm on the Water Quality and Potability Dataset,” Indones. J. …, 2023, [Online]. Available: https://jurnal.yoctobrain.org/index.php/ijodas/article/view/113.

H. Azis, L. Syafie, F. Fattah, and ..., “Unveiling Algorithm Classification Excellence: Exploring Calendula and Coreopsis Flower Datasets with Varied Segmentation Techniques,” 2024 18th Int. …, 2024, [Online]. Available: https://ieeexplore.ieee.org/abstract/document/10418246/.

H. Azis and S. R. Jabir, “Chemical Composition and Aroma Profiling: Decision Tree Modeling of Formalin Tofu,” J. Embed. Syst. Secur. …, 2023, [Online]. Available: https://journal.unm.ac.id/index.php/JESSI/article/view/1162.

Downloads

Published

2024-05-31