Dynamic Assessment: Using Technology to Enable and Extend Performance Measurement

There is a growing consensus that assessment and evaluation of human-machine systems must necessarily incorporate human performance measurement; we believe that simplified data collection and data reduction are integral components of this process. Until recently, there was a paucity of tools that could support this need; however, this state of affairs is beginning to change. Researchers are beginning to realize that sophisticated systems demand sophisticated performance measurement tools in order to support real-time, dynamic assessment. To this end, we adapted and tested a TARGETsbased (Targeted Acceptable Responses to Generated Events or Tasks) performance methodology on a handheld device (HHD) for use by Division Artillery training staff. Over a three day extended exercise, data was collected in four cells with a minimum number of problems. Features of the software tool included: access to on-demand checklists, triggering of checklists by pre-scripted events, access to the exercise’s master events list, and the ability to save ink notes. User feedback from the initial test of the HHD-based tool was positive. We provide a brief summary of this feedback, along with suggestions as to how technology-enhanced methodologies can support and enable dynamic performance measurement now and in the future.