Human Perception of Inertial Mass for Joint Human-Robot Object Manipulation

In this article, we investigate human perception of inertial mass discrimination in active planar manipulations, as they are common in daily tasks, such as moving heavy and bulky objects. Psychophysical experiments were conducted to develop a human inertial mass perception model to improve usability and acceptance of novel haptically collaborating robotic systems. In contrast to existing literature, large-scale movements involving a broad selection of reference stimuli and larger sample sizes were used. Linear mixed models were fitted to model dependent errors from the longitudinal perceptual data. Differential thresholds near the perception boundary exponentially increased and resulted in constant behavior for higher stimuli. No effect of different directions (sagittal and transversal) was found; however, a large effect of different movement types (precise and imprecise) was present in the data. Recommendations to implement the findings in novel physical assist devices are given.

[1]  Nikos A. Aspragathos,et al.  Online Stability in Human-Robot Cooperation with Admittance Control , 2016, IEEE Transactions on Haptics.

[2]  Alessandro Moscatelli,et al.  Modeling psychophysical data at the population-level: the generalized linear mixed model. , 2012, Journal of vision.

[3]  Clément Gosselin,et al.  Variable admittance control of a four-degree-of-freedom intelligent assist device , 2012, 2012 IEEE International Conference on Robotics and Automation.

[4]  Toru Tsumugiwa,et al.  Stability analysis for impedance control of robot for human-robot cooperative task system , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[5]  Richard Honeck,et al.  Experimental Design and Analysis , 2006 .

[6]  Brady T. West,et al.  Linear Mixed Models: A Practical Guide Using Statistical Software , 2006 .

[7]  Cagatay Basdogan,et al.  Recognition of Haptic Interaction Patterns in Dyadic Joint Object Manipulation , 2015, IEEE Transactions on Haptics.

[8]  Zygmunt Pizlo,et al.  Force Amplitude Perception in Six Orthogonal Directions , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[9]  Klaus Bengler,et al.  Investigation of Human Behaviour in Pushing and Pulling Tasks for Direct Manipulation of a Collaborative Robot , 2014 .

[10]  Tichauer Er,et al.  Some aspects of stress on forearm and hand in industry. , 1966 .

[11]  John C. Baird,et al.  Fundamentals of scaling and psychophysics , 1978 .

[12]  Klaus Bengler,et al.  Human Centered Assistance Applications for the working environment of the future , 2015 .

[13]  Thorsten A. Kern,et al.  Engineering Haptic Devices , 2014, Springer Series on Touch and Haptic Systems.

[14]  M T Turvey,et al.  Weight perception and the haptic size-weight illusion are functions of the inertia tensor. , 1996, Journal of experimental psychology. Human perception and performance.

[15]  Paolo Fiorini,et al.  Evaluation of force and torque magnitude discrimination thresholds on the human hand-arm system , 2010, TAP.

[16]  Jan Christian Albiez,et al.  Human Force Discrimination during Active Arm Motion for Force Feedback Design , 2013, IEEE Transactions on Haptics.

[17]  A. Kappers,et al.  Haptic Perception of Force , 2016 .

[18]  Brian Peacock,et al.  Cobots for the automobile assembly line , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[19]  H. Kazerooni,et al.  A Review of the Exoskeleton and Human Augmentation Technology , 2008 .

[20]  E. Viikari-Juntura,et al.  Proper manual handling techniques to prevent low back pain, a Cochrane systematic review. , 2012, Work.

[21]  Shinichi Nakagawa,et al.  A general and simple method for obtaining R2 from generalized linear mixed‐effects models , 2013 .

[22]  Xing-Dong Yang,et al.  Perception of haptic force magnitude during hand movements , 2008, 2008 IEEE International Conference on Robotics and Automation.

[23]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[24]  Cagatay Basdogan,et al.  Haptics in virtual environments: taxonomy, research status, and challenges , 1997, Comput. Graph..

[25]  H. Ross,et al.  Weber Fractions for Weight and Mass as a Function of Stimulus Intensity , 1987, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[26]  Klaus Bengler,et al.  Human Centered Assistance Applications for Production , 2014 .

[27]  P A Hancock,et al.  Imposing limits on autonomous systems , 2017, Ergonomics.

[28]  Alexander Verl,et al.  Cooperation of human and machines in assembly lines , 2009 .

[29]  Matthias Harders,et al.  User-based evaluation of data-driven haptic rendering , 2010, TAP.

[30]  Nikos A. Aspragathos,et al.  Variable admittance control in pHRI using EMG-based arm muscles co-activation , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[31]  R. Klatzky,et al.  Hand movements: A window into haptic object recognition , 1987, Cognitive Psychology.

[32]  Andrew A. Goldenberg,et al.  Force Discrimination Ability of the Human Hand near Absolute Threshold for the Design of Force Feedback Systems in Teleoperations , 2016, PRESENCE: Teleoperators and Virtual Environments.

[33]  R. Xu Measuring explained variation in linear mixed effects models , 2003, Statistics in medicine.

[34]  Clément Gosselin,et al.  Stable and Intuitive Control of an Intelligent Assist Device , 2012, IEEE Transactions on Haptics.

[35]  Jens P. Wulfsberg,et al.  Human Hybrid Robot, Next-generation Support Technology for Manual Tasks: Challenges, Perspectives and Economic Implications , 2015 .

[36]  I. ClintHeyer Human-Robot Interaction and Future Industrial Robotics Applications , 2010 .

[37]  Thomas B. Sheridan,et al.  Human–Robot Interaction , 2016, Hum. Factors.

[38]  Jeroen B. J. Smeets,et al.  Moving the Weber Fraction: The Perceptual Precision for Moment of Inertia Increases with Exploration Force , 2012, PloS one.

[39]  Justin M. Fine,et al.  Perceived heaviness in the context of Newton's Second Law: Combined effects of muscle activity and lifting kinematics. , 2016, Journal of experimental psychology. Human perception and performance.

[40]  Klaus Bengler,et al.  Size-weight illusion in human-robot collaboration , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[41]  Clément Gosselin,et al.  Investigation of human-robot interaction stability using Lyapunov theory , 2008, 2008 IEEE International Conference on Robotics and Automation.

[42]  Mark Mulder,et al.  Haptic shared control: smoothly shifting control authority? , 2012, Cognition, Technology & Work.

[43]  Astrid M. L. Kappers,et al.  Haptic perception of force , 2015, Scholarpedia.

[44]  A. Kappers,et al.  Haptic perception of gravitational and inertial mass , 2010, Attention, perception & psychophysics.

[45]  Geert Molenberghs,et al.  Linear Mixed Models in Practice , 1997 .

[46]  J. B. J. Smeets,et al.  Adjustments of fast goal-directed movements in response to an unexpected inertial load , 2004, Experimental Brain Research.

[47]  Y. Matsuoka,et al.  Perceptual limits for a robotic rehabilitation environment using visual feedback distortion , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[48]  Clément Gosselin,et al.  Modeling of physical human–robot interaction , 2016 .

[49]  Kay M. Stanney,et al.  Deriving haptic design guidelines from human physiological, psychophysical, and neurological foundations , 2004, IEEE Computer Graphics and Applications.

[50]  Antony W Goodwin,et al.  Human Ability to Scale and Discriminate Forces Typical of Those Occurring during Grasp and Manipulation , 2004, The Journal of Neuroscience.

[51]  H. Bastian Sensation and Perception.—I , 1869, Nature.

[52]  G. Box,et al.  Empirical Model-Building and Response Surfaces. , 1990 .

[53]  Bodo Winter,et al.  Linear models and linear mixed effects models in R with linguistic applications , 2013, ArXiv.

[54]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[55]  R. Baayen,et al.  Mixed-effects modeling with crossed random effects for subjects and items , 2008 .

[56]  André Crosnier,et al.  Collaborative manufacturing with physical human–robot interaction , 2016 .

[57]  Catherina Burghart,et al.  Concept for Human Robot Co-operation Integrating Artificial Haptic Perception , 2002 .

[58]  Roberta L. Klatzky,et al.  Measuring just noticeable differences for haptic force feedback: implications for rehabilitation , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[59]  Martin Buss,et al.  Human-Robot Collaboration: a Survey , 2008, Int. J. Humanoid Robotics.

[60]  Lynette A. Jones,et al.  Perceptual constancy and the perceived magnitude of muscle forces , 2003, Experimental Brain Research.

[61]  F. Lestienne Effects of inertial load and velocity on the braking process of voluntary limb movements , 1979, Experimental Brain Research.

[62]  Klaus Bengler,et al.  A trouble shared is a trouble halved — Usability measures for Human-Robot Collaboration , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[63]  C E Chapman,et al.  Active versus passive touch: factors influencing the transmission of somatosensory signals to primary somatosensory cortex. , 1994, Canadian journal of physiology and pharmacology.

[64]  George A. Gescheider,et al.  Psychophysics: The Fundamentals , 1997 .

[65]  J. Edward Colgate,et al.  Intelligent assist devices in industrial applications: a review , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[66]  J. Mathieu,et al.  The influence of shared mental models on team process and performance. , 2000, The Journal of applied psychology.

[67]  H E Ross,et al.  Jiggling a lifted weight does aid discrimination. , 1985, The American journal of psychology.

[68]  Allison M. Okamura,et al.  Methods for haptic feedback in teleoperated robot-assisted surgery , 2004 .

[69]  Allison M. Okamura,et al.  Speed-Accuracy Characteristics of Human-Machine Cooperative Manipulation Using Virtual Fixtures With Variable Admittance , 2004, Hum. Factors.

[70]  L. A. Jones Matching Forces: Constant Errors and Differential Thresholds , 1989, Perception.

[71]  George E. P. Box,et al.  Empirical Model‐Building and Response Surfaces , 1988 .

[72]  Christoph Doerrer,et al.  Simulating push-buttons using a haptic display : requirements on force resolution and force-displacement curve , 2001 .

[73]  Robin R. Murphy,et al.  Human-Robot Interaction , 2012 .

[74]  Jonas Schmidtler,et al.  Influence of Size-Weight Illusion on Usability in Haptic Human-Robot Collaboration , 2018, IEEE Transactions on Haptics.

[75]  J. Flanagan,et al.  Independence of perceptual and sensorimotor predictions in the size–weight illusion , 2000, Nature Neuroscience.

[76]  Kay M. Stanney,et al.  Realizing the full potential of virtual reality: human factors issues that could stand in the way , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[77]  Ryojun Ikeura,et al.  Improving Interactions between a Power-Assist Robot System and Its Human User in Horizontal Transfer of Objects Using a Novel Adaptive Control Method , 2012, Adv. Hum. Comput. Interact..

[78]  Nadine B. Sarter,et al.  How in the World Did We Ever Get into That Mode? Mode Error and Awareness in Supervisory Control , 1995, Hum. Factors.

[79]  H. Ross,et al.  Mass estimation and discrimination during brief periods of zero gravity , 1982, Perception & psychophysics.

[80]  Thorsten A. Kern,et al.  Engineering Haptic Devices: A Beginner's Guide , 2014 .

[81]  Sandra Hirche,et al.  Haptic Telepresence in Packet Switched Communication Networks , 2005 .

[82]  Ferdinando A. Mussa-Ivaldi,et al.  Haptic Human-Robot Interaction , 2012 .

[83]  Marie Laure Delignette-Muller,et al.  A Toolbox for Nonlinear Regression in R: The Package nlstools , 2015 .

[84]  Giovani J.C. da Silveira,et al.  The mass customization decade: An updated review of the literature , 2012 .

[85]  Jean-Michel Hoc Human-Machine Cooperation , 2013 .

[86]  Grigore C. Burdea,et al.  Force and Touch Feedback for Virtual Reality , 1996 .

[87]  M. Leek Adaptive procedures in psychophysical research , 2001, Perception & psychophysics.

[88]  Marc O. Ernst,et al.  Haptic perception in interaction with other senses , 2008 .

[89]  L. Jones,et al.  Perception of force and weight: theory and research. , 1986, Psychological bulletin.

[90]  Dan Stoianovici,et al.  Effect of a Pneumatically Driven Haptic Interface on the Perceptional Capabilities of Human Operators , 1998, Presence.

[91]  Gaurav S. Sukhatme,et al.  Introduction to Haptics , 2001 .

[92]  Antonio Bicchi,et al.  An atlas of physical human-robot interaction , 2008 .

[93]  Etienne Burdet,et al.  Human Robotics: Neuromechanics and Motor Control , 2013 .

[94]  David A. Abbink,et al.  Neuromuscular analysis of haptic gas pedal feedback during car following , 2006 .

[95]  N. Durlach,et al.  Manual discrimination of force using active finger motion , 1991, Perception & psychophysics.

[96]  Wayne Lee EXperimental design and analysis , 1975 .

[97]  Michael J. Griffin,et al.  Driver perception of steering feel , 2007 .