Usability evaluation ecological validity: Is more always better?

Simple item page
dc.contributor.authorMarcilly, Romaric
dc.contributor.authorMonkman, Helen
dc.contributor.authorPelayo, Sylvia
dc.contributor.authorLesselroth, Blake J.
dc.date.accessioned2024-10-10T17:23:08Z
dc.date.available2024-10-10T17:23:08Z
dc.date.issued2024
dc.description.abstractBackground: The ecological validity associated with usability testing of health information technologies (HITs) can affect test results and the predictability of real-world performance. It is, therefore, necessary to identify conditions with the greatest effect on validity. Method: We conducted a comparative analysis of two usability testing conditions. We tested a HIT designed for anesthesiologists to detect pain signals and compared two fidelity levels of ecological validity. We measured the difference in the number and type of use errors identified between high and low-fidelity experimental conditions. Results: We identified the same error types in both test conditions, although the number of errors varied as a function of the condition. The difference in total error counts was relatively modest and not consistent across levels of severity. Conclusions: Increasing ecological validity does not invariably increase the ability to detect use errors. Our findings suggest that low-fidelity tests are an efficient way to identify and mitigate usability issues affecting ease of use, effectiveness, and safety. We believe early low-fidelity testing is an efficient but underused way to maximize the value of usability testing.
dc.description.reviewstatusReviewed
dc.description.scholarlevelFaculty
dc.description.sponsorshipThis research was funded by the French Agence Nationale de la Recherche (grant number: ANR-15-CE36–0007).
dc.identifier.citationMarcilly, R., Monkman, H., Pelayo, S., & Lesselroth, B. J. (2024). Usability evaluation ecological validity: Is more always better? Healthcare, 12(14), Article 14. https://doi.org/10.3390/healthcare12141417
dc.identifier.urihttps://doi.org/10.3390/healthcare12141417
dc.identifier.urihttps://hdl.handle.net/1828/20517
dc.language.isoen
dc.publisherHealthcare
dc.rightsAttribution CC BY
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subject.departmentSchool of Health Information Science
dc.titleUsability evaluation ecological validity: Is more always better?
dc.typeArticle

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
marcilly_romaric_healthcare_2024.pdf
Size:
764.21 KB
Format:
Adobe Portable Document Format
Download

Collections

Faculty and Staff Publications
 
University of Victoria Libraries

We acknowledge and respect the Lək̓ʷəŋən (Songhees and Esquimalt) Peoples on whose territory the university stands, and the Lək̓ʷəŋən and W̱SÁNEĆ Peoples whose historical relationships with the land continue to this day.