Machine learning classification meets migraine: recommendations for study evaluation

J Headache Pain. 2024 Dec 5;25(1):215. doi: 10.1186/s10194-024-01924-x.

Abstract

The integration of machine learning (ML) classification techniques into migraine research has offered new insights into the pathophysiology and classification of migraine types and subtypes. However, inconsistencies in study design, lack of methodological transparency, and the absence of external validation limit the impact and reproducibility of such studies. This paper presents a framework of six essential recommendations for evaluating ML-based classification in migraine research: (1) group homogenization by clinical phenotype, attack frequency, comorbidity, therapy, and demographics; (2) defining adequate sample size; (3) quality control of collected and preprocessed data; (4) transparent training, testing, and performance evaluation of ML models, including strategies for data splitting, overfitting control, and feature selection; (5) interpretability of results with clinical relevance; and (6) open data and code sharing to facilitate reproducibility. These recommendations aim to balance the trade-off between model generalization and precision while encouraging collaborative standardization across the ML and headache communities. Furthermore, this framework intends to stimulate discussion toward forming a consortium to establish definitive guidelines for ML-based classification research in migraine field.

Keywords: Benchmark; Data quality; Machine learning classification models; Migraine types; Model interpretability; Model reproducibility.

Publication types

  • Review

MeSH terms

  • Humans
  • Machine Learning*
  • Migraine Disorders* / classification
  • Migraine Disorders* / diagnosis
  • Reproducibility of Results