A simulation-based embedded probe technique for human-computer interaction evaluation

There is growing interest in developing video-based methods to evaluate the usefulness and usability of computerised tools in healthcare. In this paper, we propose a human-computer interaction evaluation method that protects the confidentiality of patient information and reduces litigation risks for participants by embedding and analysing performance on “probes” in complex scenarios with high face validity in a simulated setting. We describe the application of the method to a series of three studies of bar code medication administration (BCMA) software, used to reduce medication errors in the Veteran’s Administration.