Sensing Shear Forces During Food Manipulation: Resolving the Trade-Off Between Range and Sensitivity

Autonomous assistive feeding systems need to acquire deformable food items of varying physical characteristics to be able to feed users. However, bite acquisition of these deformable food items is challenging without force feedback of appropriate range and sensitivity. We developed custom solutions using two widely-used shear sensing fingertip tactile sensors and calibrated them to the range of forces needed for manipulating food items. We compared their performance with traditional force/torque sensors and showed the trade-off between the range and the sensitivity of the fingertip tactile sensors in detecting potential bite acquisition successes for food items with widely varying weights and compliance. We then developed a control policy, using which a robotic gripper equipped with the fingertip tactile sensors can autonomously regulate the sensing range and the sensitivity to be able to skewer food items of different compliance and detect their bite acquisition success attempts.

[1]  L. Perry.  Assisted feeding. , 2008, Journal of advanced nursing.

[2]  Christopher G. Atkeson,et al.  Implementing tactile behaviors using FingerVision , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[3]  Veronica J. Santos,et al.  Bioinspired flexible microfluidic shear force sensor skin , 2017 .

[4]  Edward H. Adelson,et al.  GelSight: High-Resolution Robot Tactile Sensors for Estimating Geometry and Force , 2017, Sensors.

[5]  R. Gieleta,et al.  Rubber Structure under Dynamic Loading – Computational Studies , 2013 .

[6]  Ravinder Dahiya,et al.  Robotic Tactile Perception of Object Properties: A Review , 2017, ArXiv.

[7]  Ashutosh Saxena,et al.  Learning haptic representation for manipulating deformable food objects , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Philip J. Mott,et al.  Limits to Poisson's ratio in isotropic materials—general result for arbitrary deformation , 2009, 1204.3859.

[9]  Siddhartha S. Srinivasa,et al.  Towards Robotic Feeding: Role of Haptics in Fork-Based Food Manipulation , 2018, IEEE Robotics and Automation Letters.

[10]  A. Kamran,et al.  Mechanical Characterization and FE Modelling of a Hyperelastic Material , 2015 .

[11]  Leif Kari,et al.  An efficient method for obtaining the hyperelastic properties of filled elastomers in finite strain applications , 2015 .

[12]  Qingsheng Yang,et al.  Extracting the isotropic uniaxial stress-strain relationship of hyperelastic soft materials based on new nonlinear indentation strain and stress measure , 2018, AIP Advances.

[13]  Naoki Kawakami,et al.  Finger-Shaped GelForce: Sensor for Measuring Surface Traction Fields for Robotic Hand , 2010, IEEE Transactions on Haptics.

[14]  H. Darijani,et al.  Constitutive modeling of isotropic hyperelastic materials in an exponential framework using a self-contained approach , 2014 .

[15]  Belhassen-Chedli Bouzgarrou,et al.  Robotic manipulation and sensing of deformable objects in domestic and industrial applications: a survey , 2018, Int. J. Robotics Res..

[16]  Gaurav S. Sukhatme,et al.  Force estimation and slip detection/classification for grip control using a biomimetic tactile sensor , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[17]  Giulio Sandini,et al.  Tactile Sensing—From Humans to Humanoids , 2010, IEEE Transactions on Robotics.

[18]  Véronique Perdereau,et al.  Tactile sensing in dexterous robot hands - Review , 2015, Robotics Auton. Syst..

[19]  Christopher G. Atkeson,et al.  Combining finger vision and optical tactile sensing: Reducing and handling errors while cutting vegetables , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[20]  Jeffrey C. Trinkle,et al.  The application of particle filtering to grasping acquisition with visual occlusion and tactile sensing , 2012, 2012 IEEE International Conference on Robotics and Automation.

[21]  Edward H. Adelson,et al.  Measurement of shear and slip with a GelSight tactile sensor , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Alexandre Campeau-Lecours,et al.  Kinova Modular Robot Arms for Service Robotics Applications , 2017, Int. J. Robotics Appl. Technol..

[23]  H. Kinoshita,et al.  Control of Precision Grip Force in Lifting and Holding of Low-Mass Objects , 2015, PloS one.

[24]  Á. Tar,et al.  Development of a low cost 3D optical compliant tactile force sensor , 2011, 2011 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[25]  Siddhartha S. Srinivasa,et al.  Transfer Depends on Acquisition: Analyzing Manipulation Strategies for Robotic Feeding , 2019, 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[26]  Tsukasa Ogasawara,et al.  Grip force control for an elastic finger using vision-based incipient slip feedback , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[27]  Veronica J. Santos,et al.  Biomimetic Tactile Sensor Array , 2008, Adv. Robotics.

[28]  Clément Gosselin,et al.  Geometric Design of Three-Phalanx Underactuated Fingers , 2006 .

[29]  M. T. Mason,et al.  Toward Robotic Manipulation , 2018, Annu. Rev. Control. Robotics Auton. Syst..

[30]  Giorgio Metta,et al.  A new design of a fingertip for the iCub hand , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).