Intent Inference of Human Hand Motion for Haptic Feedback Systems

The haptic feedback system (HFS) in the virtual cockpit system (VCS) can definitely enhance the sense of immersion. Most HFSs in prior works sacrificed the native advantages of VCSs to achieve haptic interaction. This paper addresses the problem by proposing a novel framework for the HFS, which can predict the most likely interacting target of the human hand in advance. We introduce a HFS with a non-contact visual tracking sensor and a probability inference method based on Bayesian statistics, the features extracted by this HFS could be low-cost, high generality and flexibility. Simulations show that human intent inference can be computed in real-time and the results can meet the requirements of the HFM, which provides an important basis for haptic interactions in VCSs.

[1]  Andrea Maria Zanchettin,et al.  Probabilistic inference of human arm reaching target for effective human-robot collaboration , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  Julie A. Shah,et al.  Fast target prediction of human reaching motion for cooperative human-robot manipulation tasks using time series classification , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Eyal Ofek,et al.  Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller , 2018, CHI.

[4]  Robert Fitch,et al.  Bayesian intention inference for trajectory prediction with an unknown goal destination , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[5]  Eyal Ofek,et al.  Demonstration of Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a VR Controller , 2018, CHI Extended Abstracts.

[6]  Ashwin P. Dani,et al.  Human Intention Inference Using Expectation-Maximization Algorithm With Online Model Learning , 2017, IEEE Transactions on Automation Science and Engineering.

[7]  C. Gardiner Handbook of Stochastic Methods , 1983 .

[8]  W. Marsden I and J , 2012 .

[9]  Ron Stonum A Survey of Immersive Technology For Maintenance Evaluations , 1998 .

[10]  Pedro Lopes,et al.  Providing Haptics to Walls & Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation , 2017, CHI.

[11]  Davide Nicolis,et al.  Human Intention Estimation based on Neural Networks for Enhanced Collaboration with Robots , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Juan Pablo Wachs,et al.  Early prediction for physical human robot collaboration in the operating room , 2017, Autonomous Robots.

[13]  Shuling Dai,et al.  Real-time kinematical optimal trajectory planning for haptic feedback manipulators , 2019, Simul..

[14]  Debasmit Das,et al.  Cross-Scene Trajectory Level Intention Inference using Gaussian Process Regression and Naive Registration , 2018 .

[15]  Lin Yang,et al.  Evaluating and Improving the Depth Accuracy of Kinect for Windows v2 , 2015, IEEE Sensors Journal.

[16]  Siddhartha S. Srinivasa,et al.  Planning-based prediction for pedestrians , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.