Haptically enabled simulation system for firearm shooting training

Firearm shooting training is of importance in military and law enforcement training tasks. Traditional training usually uses actual firearms or modified bullets that are dangerous and expensive and difficult to evaluate the performance. Firearm training simulation systems provide risk-free alternatives. However, most existing simulation is visual-only, which lacks the immersion on the force feedback. In this paper, we proposed a new firearm training simulation system, which can provide more realistic training by incorporating physic effects on recoil and trigger pull weight. Dynamic, immersive, and repeatable training experiences while imposes no danger to trainees are provided in our system. The system consists of haptics, physics engine, and motion capture. These three components are carefully combined by developing the corresponding techniques of haptic force rendering, visuo-haptic integration, and synchronisation, physics-based dynamic simulation and motion analysis. Compared with existing systems, our training system has more complete functionalities that include visual firearm shooting, force generation, shooting reactions, result analysis and evaluation. Moreover, it is adaptable to off-the-shelf hardware and software packages and thus it can provide flexibility to system scalability and budget. To evaluate the proposed system, two demonstrations are conducted for users where the systems accuracy, immersion and usability are analysed. The results show the effectiveness of our physics-based shooting model and the proposed system on simulating different shooting scenarios.

[1]  François Conti,et al.  CHAI: An Open-Source Library for the Rapid Development of Haptic Scenes , 2005 .

[2]  Pietro Zanuttigh,et al.  Hand gesture recognition with leap motion and kinect devices , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[3]  Steven Martin,et al.  Characterisation of the Novint Falcon Haptic Device for Application as a Robot Manipulator , 2009 .

[4]  Alexei Sourin,et al.  Visual immersive haptic mathematics , 2009, Virtual Reality.

[5]  Roope Raisamo,et al.  Distinguishing Vibrotactile Effects with Tactile Mouse and Trackball , 2005, BCS HCI.

[6]  Joaquim B. Cavalcante Neto,et al.  System Model for Shooting Training Based on Interactive Video, Three-Dimensional Computer Graphics and Laser Ray Capture , 2012, 2012 14th Symposium on Virtual and Augmented Reality.

[7]  H Arioui,et al.  Mechatronics, Design, and Modeling of a Motorcycle Riding Simulator , 2010, IEEE/ASME Transactions on Mechatronics.

[8]  António M. Lopes,et al.  A new type haptics-based virtual environment system for assembly training of complex products , 2011, The International Journal of Advanced Manufacturing Technology.

[9]  K. Sunnerhagen,et al.  Virtual reality and haptics as a training device for movement rehabilitation after stroke: a single-case study. , 2004, Archives of Physical Medicine and Rehabilitation.

[10]  Saeid Nahavandi,et al.  Integrating Kinect and haptics for interactive STEM education in local and distributed environments , 2013, 2013 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[11]  Kyoungju Park,et al.  Enhanced player interaction using motion controllers for VR FPS , 2017, 2017 IEEE International Conference on Consumer Electronics (ICCE).

[12]  Alexei Sourin,et al.  Function-based visualization and haptic rendering in shared virtual spaces , 2008, The Visual Computer.

[13]  John Kenneth Salisbury,et al.  A constraint-based god-object method for haptic display , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[14]  Susana Costa e Silva,et al.  The value of textual haptic information in online clothing shopping , 2017 .

[15]  Ben Horan,et al.  Haptic Technology for Micro-robotic Cell Injection Training Systems - A Review , 2016, Intell. Autom. Soft Comput..

[16]  Aryuanto Soetedjo,et al.  Implementation of sensor on the gun system using embedded camera for shooting training , 2014, 2014 2nd International Conference on Technology, Informatics, Management, Engineering & Environment.

[17]  Blake Hannaford,et al.  Pen-based force display for precision manipulation in virtual environments , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[18]  Petr Kadle Overview of current developments in haptic APIs , 2011 .

[19]  Huan Tong,et al.  Combat effectiveness evaluation of firearms system based on MMESE , 2010, 2010 International Conference on Information, Networking and Automation (ICINA).

[20]  Zhengyou Zhang,et al.  Microsoft Kinect Sensor and Its Effect , 2012, IEEE Multim..

[21]  Oussama Khatib,et al.  The haptic display of complex graphical environments , 1997, SIGGRAPH.

[22]  Hong Z. Tan,et al.  The Effect of Virtual Haptic Training on Real Surgical Drilling Proficiency , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[23]  Guanyang Liu,et al.  Networked tank gunnery skill training based on haptic interaction , 2011, 2011 4th International Conference on Biomedical Engineering and Informatics (BMEI).

[24]  Saeid Nahavandi,et al.  Immersive Visuo-Haptic Rendering in Optometry Training Simulation , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[25]  Frank Weichert,et al.  Analysis of the Accuracy and Robustness of the Leap Motion Controller , 2013, Sensors.

[26]  John Kenneth Salisbury,et al.  Phantom-Based Haptic Interaction with Virtual Objects , 1997, IEEE Computer Graphics and Applications.

[27]  Thomas A. DeFanti,et al.  Haptics-based virtual reality periodontal training simulator , 2009, Virtual Reality.

[28]  Shulong Li The Design and Implementation of Shooting System Simulation Platform for Police College , 2009, 2009 International Conference on Scalable Computing and Communications; Eighth International Conference on Embedded Computing.