A Multi-Sample Comparison and Rasch Analysis of the Evaluation of Children's Listening and Processing Skills Questionnaire

Abstract

Objectives: Assessing listening difficulties and associated complaints can be challenging. Often, measures of peripheral auditory functions are within normal ranges, making clinicians feel unsure about proper management strategies. The range and nature of observed or experienced difficulties might be better captured using a qualitative measure. The Evaluation of Children's Listening and Processing Skills (ECLiPS) questionnaire was designed to broadly profile the auditory and cognitive problems often present in children with listening difficulties. This 38-item questionnaire was initially standardized in British children aged 6 to 11 years, was subsequently modified for use with North-American children, and was recently translated into Flemish-Dutch. This study aimed to compare typical scores of the Flemish version with the UK and US versions, and to evaluate and compare its psychometric quality based on Rasch analysis.

Design: We selected 112 Flemish children aged 6 to 11 years with verified normal hearing and typical development, and asked two caregivers of every child to fill out the ECLiPS. Data from two comparator samples were analyzed, including responses for 71 North-American children and 650 British children. Typical values for ECLiPS factors and aggregates were determined as a function of age and gender, and meaningful differences across samples were analyzed. Rasch analyses were performed to evaluate whether ECLiPS response categories work as intended, and whether item scores fit a linear equal interval measurement scale that works the same way for everyone. Item and person metrics were derived, including separation and reliability indices. We investigated whether items function similarly across linguistically and culturally different samples.

Results: ECLiPS scores were relatively invariant to age. Girls obtained higher scores compared with boys, mainly for items related to memory and attention, and pragmatic and social skills. Across ECLiPS versions, the most pronounced differences were found for items probing social skills. With respect to its psychometric quality, ECLiPS response categories work as intended, and ECLiPS items were found to fit the Rasch measurement scale. Cultural differences in responses were noted for some items, belonging to different factors. Item separation and reliability indices generally pointed toward sufficient variation in item difficulty. In general, person separation (and reliability) metrics, quantifying the instrument's ability to distinguish between poor and strong performers (in a reproducible manner), were low. This is expected from samples of typically developing children with homogeneous and high levels of listening ability.

Conclusions: Across the languages assessed here, the ECLiPS caregiver questionnaire was verified to be a psychometrically valid qualitative measure to assess listening and processing skills, which can be used to support the assessment and management of elementary school children referred with LiD.