Development and user evaluation of a rare disease gene prioritization workflow based on cognitive ergonomics

J Am Med Inform Assoc. 2019 Feb 1;26(2):124-133. doi: 10.1093/jamia/ocy153.

Abstract

Objective: The clinical diagnosis of genetic disorders is undergoing transformation, driven by whole exome sequencing and whole genome sequencing (WES/WGS). However, such nucleotide-level resolution technologies create an interpretive challenge. Prior literature suggests that clinicians may employ characteristic cognitive processes during WES/WGS investigations to identify disruptions in genes causal for the observed disease. Based on cognitive ergonomics, we designed and evaluated a gene prioritization workflow that supported these cognitive processes.

Materials and methods: We designed a novel workflow in which clinicians recalled known genetic diseases with similarity to patient phenotypes to inform WES/WGS data interpretation. This prototype-based workflow was evaluated against the common computational approach based on physician-specified sets of individual patient phenotypes. The evaluation was conducted as a web-based user study, in which 18 clinicians analyzed 2 simulated patient scenarios using a randomly assigned workflow. Data analysis compared the 2 workflows with respect to accuracy and efficiency in diagnostic interpretation, efficacy in collecting detailed phenotypic information, and user satisfaction.

Results: Participants interpreted genetic diagnoses faster using prototype-based workflows. The 2 workflows did not differ in other evaluated aspects.

Discussion: The user study findings indicate that prototype-based approaches, which are designed to model experts' cognitive processes, can expedite gene prioritization and provide utility in synergy with common phenotype-driven variant/gene prioritization approaches. However, further research of the extent of this effect across diverse genetic diseases is required.

Conclusion: The findings demonstrate potential for prototype-based phenotype description to accelerate computer-assisted variant/gene prioritization through complementation of skills and knowledge of clinical experts via human-computer interaction.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Clinical Competence
  • Cognition
  • Decision Making, Computer-Assisted
  • Ergonomics*
  • Exome Sequencing
  • Female
  • Genome, Human
  • Humans
  • Male
  • Rare Diseases / genetics*
  • Smith-Lemli-Opitz Syndrome / genetics
  • Tuberous Sclerosis / genetics
  • User-Computer Interface
  • Whole Genome Sequencing*
  • Workflow

Grants and funding