An analysis of questionnaires and performance measures for a simulation-based kinesic cue detection task

The attraction of Simulation-Based Training for unmanned Intelligence, Surveillance, and Reconnaissance tasks has sparked testing for instructional strategies in a kinesic cue detection task. Early evidence of training effectiveness for this task is manifested by performance and self-report measures. The wealth of surveys collected include aspects of users' technology acceptance, immersion, intrinsic motivation, stress, workload, and demographics. This paper reviews these detection task measures in light of an instructional strategy, Kim's Game. A cross-scale analysis of the provided measures indicates strong correlations between several subscales. An investigation of potential predictors of performance indicates weekly computer use is statistically significant in predicting a user's Posttest Median Response Time for behavior cue detection. Recommendations for future initiatives include adding feedback, questioning concern for increasing immersion, and comparing results to other instructional strategies.

[1]  A. W. Evans,et al.  Investigating the Usefulness of Soldier Aids for Autonomous Unmanned Ground Vehicles, Part 2 , 2015 .

[2]  Amanda K. Emo,et al.  Emotional intelligence, personality, and task-induced stress. , 2006, Journal of experimental psychology. Applied.

[3]  Edward L. Deci,et al.  The Empirical Exploration of Intrinsic Motivational Processes1 , 1980 .

[4]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[5]  Denise Nicholson,et al.  Border Hunter Research Technical Report , 2010 .

[6]  Joseph A. DeVito.  Kinesics: Other codes, other channels , 1968 .

[7]  John Ingham,et al.  Why do people use information technology? A critical review of the technology acceptance model , 2003, Inf. Manag..

[8]  Susan C. Fischer,et al.  Training Strategies for Tactical Pattern Recognition. , 1996 .

[9]  Viswanath Venkatesh,et al.  Determinants of Perceived Ease of Use: Integrating Control, Intrinsic Motivation, and Emotion into the Technology Acceptance Model , 2000, Inf. Syst. Res..

[10]  William R. King,et al.  A meta-analysis of the technology acceptance model , 2006, Inf. Manag..

[11]  M. Csíkszentmihályi.  Flow: The Psychology of Optimal Experience , 1990 .

[12]  L. R. Peterson.  Short-term memory. , 1966, Scientific American.

[13]  Regan L. Mandryk,et al.  Fostering Intrinsic Motivation through Avatar Identification in Digital Games , 2016, CHI.

[14]  R. Birdwhistell.  Kinesics and Context: Essays on Body Motion Communication , 1971 .

[15]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[16]  William R. Sherman,et al.  Understanding Virtual RealityInterface, Application, and Design , 2002, Presence: Teleoperators & Virtual Environments.

[17]  Rebecca A. Grier,et al.  Fundamental dimensions of subjective state in performance settings: task engagement, distress, and worry. , 2002, Emotion.

[18]  Michela Terenzi,et al.  A Random Glance at the Flight Deck: Pilots' Scanning Strategies and the Real-Time Assessment of Mental Workload , 2007 .

[19]  Yair Levy,et al.  Integrating Trust and Computer Self-Efficacy with TAM: AnEmpirical Assessment of Customersâ Acceptance of BankingInformation Systems (BIS) in Jamaica , 2008 .

[20]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[21]  Mel Slater,et al.  Taking steps: the influence of a walking technique on presence in virtual reality , 1995, TCHI.

[22]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[23]  Grant Taylor,et al.  Establishing Workload Manipulations Utilizing a Simulated Environment , 2013, HCI.

[24]  Glenda A. Gunter,et al.  Taking educational games seriously: using the RETAIN model to design endogenous fantasy into standalone educational games , 2008 .

[25]  Janice Baranowski,et al.  Story Immersion in a Health Videogame for Childhood Obesity Prevention. , 2012, Games for health journal.

[26]  Yair Levy,et al.  An Empirical Study of Computer Self-Efficacy and the Technology Acceptance Model in the Military: A Case of a U.S. Navy Combat Information System , 2009, J. Organ. End User Comput..

[27]  Andreas Gegenfurtner,et al.  Digital simulation-based training: A meta-analysis , 2014, Br. J. Educ. Technol..

[28]  Crystal S. Maraj,et al.  Investigating Simulation-Based Pattern Recognition Training For Behavior Cue Detection , 2015 .

[29]  J. Reeve,et al.  The interest-enjoyment distinction in intrinsic motivation , 1989 .

[30]  Mel Slater,et al.  Immersion, presence and performance in virtual environments: an experiment with tri-dimensional chess , 1996, VRST.

[31]  Suprateek Sarker,et al.  Understanding mobile handheld device use and adoption , 2003, CACM.

[32]  George D. Konetes.  The Function of Intrinsic and Extrinsic Motivation in Educational Virtual Games and Simulations (Rising Scholar Paper) , 2010 .

[33]  Charles E. Hughes,et al.  The use of functional L-systems for scenario generation in serious games , 2010, PCGames@FDG.

[34]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[35]  R. Ryan,et al.  Relation of reward contingency and interpersonal context to intrinsic motivation: A review and test using cognitive evaluation theory. , 1983 .