A Medical Student Inquiry Behavior Assessment Tool: Development and Validity Evidence

Acad Med. 2019 Apr;94(4):586-594. doi: 10.1097/ACM.0000000000002520.

Abstract

Purpose: The University of California, San Francisco (UCSF) School of Medicine's Bridges curriculum is designed to teach inquiry: the process of approaching problems with curiosity, challenging current concepts, and creating new knowledge. The authors aimed to develop and gather validity evidence for a tool to guide development of medical student inquiry behaviors in small groups.

Method: The authors reviewed the literature to identify inquiry behaviors, verified findings with an expert focus group, and synthesized the results into 40 behaviors. In a modified two-round Delphi survey in 2016, faculty and students rated the behaviors for inclusion in the tool. Feedback from cognitive interviews and a pilot helped refine the tool. In 2016-2017, the authors implemented the final tool for 152 first-year UCSF medical students in inquiry small groups as a faculty assessment and a student self-assessment each quarter.

Results: The two-round response rate was 77% (36/47). Five behaviors were selected for inclusion in the tool: select relevant questions to pursue; justify explanations with evidence; critically evaluate his/her explanation in light of alternative possibilities; allow for the possibility that his/her own knowledge may not be completely correct; and collaborate well with peers. During implementation, faculty and student scores increased on most items, indicating skills development over time. Content, response process, internal structure, and consequential validity evidence is presented.

Conclusions: The tool's five items are observable, measurable core inquiry behaviors. The tool is ready for use by small-group facilitators within inquiry-based curricula to promote student self-assessment and guide feedback to students.

MeSH terms

  • Delphi Technique
  • Education, Medical, Undergraduate / methods
  • Education, Medical, Undergraduate / trends
  • Feedback
  • Humans
  • Interviews as Topic / methods
  • Problem Behavior / psychology*
  • Reproducibility of Results
  • San Francisco
  • Students, Medical / psychology*
  • Surveys and Questionnaires