Longitudinal stability and predictive value of socio/emotional/behavioral screening in an Outpatient Pediatric Network

R Christopher Sheldrick; Justin Birudavol; Dina R Hirshfeld-Becker; Alice S Carter; Ellen C Perrin; Anamika Dutta; Talia S Benheim; Juliana M Holcomb; Alexy Arauz Boudreau; Michael S Jellinek; J Michael Murphy

doi:10.1016/j.acap.2024.102618

Longitudinal stability and predictive value of socio/emotional/behavioral screening in an Outpatient Pediatric Network

Acad Pediatr. 2024 Dec 12:102618. doi: 10.1016/j.acap.2024.102618. Online ahead of print.

Affiliations

¹ Department of Psychiatry, UMass Chan School of Medicine, Worcester, MA. Electronic address: radley.sheldrick@umassmed.edu.
² Department of Psychology, University of Massachusetts Boston, Boston, MA.
³ Department of Psychiatry, Massachusetts General Hospital, Boston, MA; Department of Psychiatry, Harvard Medical School, Boston, MA; Child Cognitive Behavioral Therapy Program, Massachusetts General Hospital, Boston, MA.
⁴ Department of Pediatrics, Tufts Medical Center, Boston, MA.
⁵ Department of Psychiatry, Massachusetts General Hospital, Boston, MA.
⁶ Department of Psychiatry, Massachusetts General Hospital, Boston, MA; Department of Psychology, Suffolk University, Boston, MA.
⁷ Department of Pediatrics, Massachusetts General Hospital, Boston, MA; Department of Pediatrics, Harvard Medical School, Boston, MA.
⁸ Department of Psychiatry, Massachusetts General Hospital, Boston, MA; Department of Psychiatry, Harvard Medical School, Boston, MA.

PMID: 39674345
DOI: 10.1016/j.acap.2024.102618

Abstract

Background: In 2022, the American Academy of Pediatrics recommended annual social/emotional/behavioral (SEB) screening at preventive pediatric visits. Numerous SEB screeners have considerable empirical support for children of all ages. However, few studies inform the longitudinal use of SEB screeners in pediatrics.

Methods: Using electronic health records (EHR) from seven pediatric clinics in a large hospital system, we analyze the longitudinal stability of three SEB screeners among 9,153 children and adolescents who were screened multiple times over a 3-year period, and we evaluate associations with International Classification of Disease (ICD) codes for SEB diagnoses.

Results: Moderate stability was documented for the Baby Pediatric Symptom Checklist (ICC =.57), Preschool Pediatric Symptom Checklist (ICC =.60), and Pediatric Symptom Checklist-17 (ICC =.69). Stability of positive/negative results was sensitive to each screener's threshold. Across a range of thresholds that classify 7-20% of children as positive, all three screeners achieved positive predictive values (PPVs) of approximately 40-65% and diagnostic odds ratios ranging from 8 to 15. These findings compare favorably to published results for longer measures and structured interviews. Recommended thresholds varied markedly across screeners, and associations with ICD codes demonstrate that higher thresholds yield higher specificity but lower sensitivity (i.e., a majority of ICD codes are not anticipated by positive screens).

Conclusions: Three common SEB screeners display longitudinal stability similar to longer, more established measures. Results demonstrate that recommended thresholds vary markedly across measures and that choice of threshold strongly influences sensitivity and specificity, underscoring the need for greater attention to selection of thresholds. CLINICAL TRIAL REGISTRATION (IF ANY): none.

Keywords: mass screening; pediatrics; psychopathology.