Objective: To compare the use of structured reporting software and the standard electronic medical records (EMR) in the management of patients with bladder cancer. The use of a human factors laboratory to study management of disease using simulated clinical scenarios was also assessed.
Design: eCancerCare(Bladder) and the EMR were used to retrieve data and produce clinical reports. Twelve participants (four attending staff, four fellows, and four residents) used either eCancerCare(Bladder) or the EMR in two clinical scenarios simulating cystoscopy surveillance visits for bladder cancer follow-up.
Measurements: Time to retrieve and quality of review of the patient history; time to produce and completeness of a cystoscopy report. Finally, participants provided a global assessment of their computer literacy, familiarity with the two systems, and system preference.
Results: eCancerCare(Bladder) was faster for data retrieval (scenario 1: 146 s vs 245 s, p=0.019; scenario 2: 306 vs 415 s, NS), but non-significantly slower to generate a clinical report. The quality of the report was better in the eCancerCare(Bladder) system (scenario 1: p<0.001; scenario 2: p=0.11). User satisfaction was higher with the eCancerCare(Bladder) system, and 11/12 participants preferred to use this system.
Limitations: The small sample size affected the power of our study to detect differences.
Conclusions: Use of a specific data management tool does not appear to significantly reduce user time, but the results suggest improvement in the level of care and documentation and preference by users. Also, the use of simulated scenarios in a laboratory setting appears to be a valid method for comparing the usability of clinical software.