Perceptual evaluation of severe pediatric voice disorders: rater reliability using the consensus auditory perceptual evaluation of voice

J Voice. 2010 Jul;24(4):441-9. doi: 10.1016/j.jvoice.2008.09.004. Epub 2009 Jan 9.

Abstract

The purpose of this nonrandomized prospective study was to quantify the inter- and intrarater reliability of experienced speech-language pathologist's perceptual ratings of voice in pediatric patients post-laryngotracheal reconstruction (LTR). Moderate to severe dysphonia is common in this population. Using the sentence portion of the Consensus Auditory Perceptual Evaluation-Voice (CAPE-V) rating scale, three experienced speech-language pathologists independently rated randomized voice samples of 50 participants ages 4-20 years, who had acquired or congenital airway conditions requiring at least one LTR on the six salient perceptual vocal attributes. Data collection and listening conditions were carefully controlled. Seventeen (34%) of the samples were randomly selected for rerating at a later time. Estimates of interrater reliability were strongest for perceptual ratings of breathiness (intraclass correlation coefficient [ICC]=71%), roughness (ICC=68%), pitch (ICC=68%), and overall severity (ICC=67%). Reliability was lower for ratings of loudness (ICC=57%) and strain (ICC=35%). For each rater, the intrarater reliability on all but one parameter (strain) was moderate to strong (ICC=63-93%). There was a strong interrater eliability for four of six vocal parameters rated using the CAPE-V in a population of children and adolescents with marked dysphonia. The parameter of strain, when rated by auditory sample alone and apart from the clinical context, was difficult to rate.

Publication types

  • Clinical Trial
  • Validation Study

MeSH terms

  • Adolescent
  • Child
  • Child, Preschool
  • Consensus
  • Dysphonia / diagnosis*
  • Dysphonia / surgery*
  • Female
  • Humans
  • Larynx / surgery
  • Loudness Perception
  • Male
  • Observer Variation
  • Pitch Perception
  • Plastic Surgery Procedures
  • Postoperative Complications / diagnosis*
  • Reproducibility of Results
  • Respiratory Mechanics
  • Severity of Illness Index*
  • Speech-Language Pathology / methods*
  • Speech-Language Pathology / standards*
  • Trachea / surgery
  • Voice Quality
  • Young Adult