Comparison of Machine Learning Algorithms Using Manual/Automated Features on 12-Lead Signal Electrocardiogram Classification: A Large Cohort Study on Students Aged Between 6 to 18 Years Old

Abstract

Propose: An electrocardiogram (ECG) has been extensively used to detect rhythm disturbances. We sought to determine the accuracy of different machine learning in distinguishing abnormal ECGs from normal ones in children who were examined using a resting 12-Lead ECG machine, and we also compared the manual and automated measurement using the modular ECG Analysis System (MEANS) algorithm of ECG features.

Methods: Altogether, 10745 ECGs were recorded for students aged 6 to 18. Manual and automatic ECG features were extracted for each participant. Features were normalized using Z-score normalization and went through the student's t-test and chi-squared test to measure their relevance. We applied the Boruta algorithm for feature selection and then implemented eight classifier algorithms. The dataset was split into training (80%) and test (20%) partitions. The performance of the classifiers was evaluated on the test data (unseen data) by 1000 bootstrap, and sensitivity (SEN), specificity (SPE), AUC, and accuracy (ACC) were reported.

Results: In univariate analysis, the highest performance was heart rate and RR interval in the manual dataset and heart rate in an automated dataset with AUC of 0.72 and 0.71, respectively. The best classifiers in the manual dataset were random forest (RF) and quadratic-discriminant-analysis (QDA) with AUC, ACC, SEN, and SPE equal to 0.93, 0.98, 0.69, 0.99, and 0.90, 0.95, 0.75, 0.96, respectively. In the automated dataset, QDA (AUC: 0.89, ACC:0.92, SEN:0.71, SPE:0.93) and stack learning (SL) (AUC:0.89, ACC:0.96, SEN:0.61, SPE:0.99) reached best performances.

Conclusion: This study demonstrated that the manual measurement of 12-Lead ECG features had better performance than the automated measurement (MEANS algorithm), but some classifiers had promising results in discriminating between normal and abnormal cases. Further studies can help us evaluate the applicability and efficacy of machine-learning approaches for distinguishing abnormal ECGs in community-based investigations in both adults and children.

Keywords: Classification; Electrocardiogram; Machine learning; Manual/automated features; Pediatric.