Firearms training simulator based on low cost motion tracking sensor

This paper gives an overview of new low cost firearms simulator based on a motion-tracking sensor - Microsoft Kinect that provides aiming results that are highly correlated with real live results. This simulator uses Microsoft Kinect SDK based application that utilizes the input from the embedded Kinect sensors to calculate the aiming point at the screen, recognizes the user’s gestures and the audio inputs, and emulates commands in a simulation based on those inputs. We have created three test modules that are using different calibration points and mathematical frameworks to accurately transform the gunshot targeting point in proper pixel coordinate. The initial experiments with the proposed firearms simulator show that the results that are accomplished by humans using the simulator and the results accomplished in the real live firearms shooting have a high correlation coefficient of 0.82. This shows that the proposed simulator can be used in firearms training and is a good alternative to the existing expensive simulators available on the market.

[1]  Hee Sik Kim,et al.  (n − 1)-Step Derivations on n-Groupoids: The Case n = 3 , 2014, TheScientificWorldJournal.

[2]  Stefan Gheorghe Pentiuc,et al.  Novel Interface for Simulation of Assembly Operations in Virtual Environments , 2013 .

[3]  Fillia Makedon,et al.  Audio-visual speech recognition using depth information from the Kinect in noisy video conditions , 2012, PETRA '12.

[4]  Van Bang Le.  Hand Detecting and Positioning Based on Depth Image of Kinect Sensor , 2014 .

[5]  G. W. Reddien.  Newton–Raphson Methods , 2014 .

[6]  Songde Ma,et al.  Implicit and Explicit Camera Calibration: Theory and Experiments , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Jeff Kramer,et al.  Introducing the Kinect , 2012 .

[8]  Kang Ryoung Park,et al.  A Novel Gaze Tracking Method Based on the Generation of Virtual Calibration Points , 2013, Sensors.

[9]  George M. Phillips,et al.  Chapter 12 – SYSTEMS OF NON-LINEAR EQUATIONS , 1996 .

[10]  Eui Chul Lee,et al.  Pointing Gesture Interface for Large Display Environments Based on the Kinect Skeleton Model , 2014 .

[11]  Tim Roberts,et al.  Multi-Kinect Tracking for Dismounted Soldier Training , 2012 .

[12]  Ngoc-Quan Pham,et al.  A Study of Feature Combination in Gesture Recognition with Kinect , 2014, KSE.

[13]  Alexandros Pino,et al.  Using Kinect for 2D and 3D Pointing Tasks: Performance Evaluation , 2013, HCI.

[14]  Albert A. Rizzo,et al.  FAAST: The Flexible Action and Articulated Skeleton Toolkit , 2011, 2011 IEEE Virtual Reality Conference.

[15]  Yiyu Yao,et al.  Performance of modern gaming input devices in first-person shooter target acquisition , 2014, CHI Extended Abstracts.

[16]  Zhengyou Zhang,et al.  Microsoft Kinect Sensor and Its Effect , 2012, IEEE Multim..

[17]  J-L. Liu,et al.  Assessment of range of shoulder motion using Kinect , 2014 .

[18]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[19]  Pan Jing,et al.  Human-computer Interaction using Pointing Gesture based on an Adaptive Virtual Touch Screen , 2013 .

[20]  Qing Zhu,et al.  Human posture recognition based on kinect depth images , 2014 .

[21]  Mineichi Kudo,et al.  Efficient action recognition via local position offset of 3D skeletal body joints , 2015, Multimedia Tools and Applications.

[22]  Hyotaek Lim,et al.  Hand tracking and gesture recognition system for human-computer interaction using low-cost hardware , 2015, Multimedia Tools and Applications.

[23]  Weifeng Chen,et al.  Editorial: advances in multimedia and ubiquitous technologies for the new era , 2012, Multimedia Tools and Applications.

[24]  Eui Chul Lee,et al.  Method for User Interface of Large Displays Using Arm Pointing and Finger Counting Gesture Recognition , 2014, TheScientificWorldJournal.

[25]  A. Portela,et al.  ABS projection algorithms — Mathematical techniques for linear and nonlinear equations , 1992 .

[26]  Pedro Arias,et al.  Metrological evaluation of Microsoft Kinect and Asus Xtion sensors , 2013 .

[27]  Masahiro Takatsuka,et al.  Estimating virtual touchscreen for fingertip interaction with large displays , 2006, OZCHI '06.

[28]  Noel E. O'Connor,et al.  Real-Time Gaze Estimation Using a Kinect and a HD Webcam , 2014, MMM.