Human-Inspired Robotic Grasp Control With Tactile Sensing

We present a novel robotic grasp controller that allows a sensorized parallel jaw gripper to gently pick up and set down unknown objects once a grasp location has been selected. Our approach is inspired by the control scheme that humans employ for such actions, which is known to centrally depend on tactile sensation rather than vision or proprioception. Our controller processes measurements from the gripper's fingertip pressure arrays and hand-mounted accelerometer in real time to generate robotic tactile signals that are designed to mimic human SA-I, FA-I, and FA-II channels. These signals are combined into tactile event cues that drive the transitions between six discrete states in the grasp controller: Close, Load, Lift and Hold, Replace, Unload, and Open. The controller selects an appropriate initial grasping force, detects when an object is slipping from the grasp, increases the grasp force as needed, and judges when to release an object to set it down. We demonstrate the promise of our approach through implementation on the PR2 robotic platform, including grasp testing on a large number of real-world objects.

[1]  Daniel E. Whitney,et al.  Historical Perspective and State of the Art in Robot Force Control , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[2]  David Dornfeld,et al.  Slip detection using acoustic emission signal analysis , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[3]  Imin Kao,et al.  Grasping, manipulation, and control with tactile sensing , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[4]  M. Srinivasan,et al.  Tactile detection of slip: surface microgeometry and peripheral neural codes. , 1990, Journal of neurophysiology.

[5]  John Kenneth Salisbury,et al.  Application of Change Detection to Dynamic Contact Sensing , 1994, Int. J. Robotics Res..

[6]  J. Bell,et al.  The structure and function of pacinian corpuscles: A review , 1994, Progress in Neurobiology.

[7]  Kenneth O. Johnson,et al.  The roles and functions of cutaneous mechanoreceptors , 2001, Current Opinion in Neurobiology.

[8]  Roberta L. Klatzky,et al.  Measuring just noticeable differences for haptic force feedback: implications for rehabilitation , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[9]  Robert O. Ambrose,et al.  Tactile gloves for autonomous grasping with the NASA/DARPA Robonaut , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[10]  L. Natale,et al.  A Sensitive Approach to Grasping , 2005 .

[11]  E. Torres-Jara,et al.  Challenges for Robot Manipulation in Human Environments , 2006 .

[12]  Ferenc Kovács,et al.  Grasp planning based on fingertip contact forces and torques , 2006 .

[13]  Charles C. Kemp,et al.  Challenges for robot manipulation in human environments [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[14]  John H. Wright,et al.  Information-Processing Channels in the Tactile Sensory System: A Psychophysical and Physiological Analysis , 2008 .

[15]  Masatsugu Iribe,et al.  Adaptive grasping by multi fingered hand with tactile sensor based on robust force and position control , 2008, 2008 IEEE International Conference on Robotics and Automation.

[16]  Giorgio Metta,et al.  A prototype fingertip with high spatial resolution pressure sensing for the robot iCub , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[17]  Ashutosh Saxena,et al.  Robotic Grasping of Novel Objects using Vision , 2008, Int. J. Robotics Res..

[18]  M. Ohka,et al.  Tactile Sensing-Based Control Architecture in Multi-Fingered Arm for Object Manipulation , 2008, Eng. Lett..

[19]  Veronica J. Santos,et al.  Biomimetic Tactile Sensor Array , 2008, Adv. Robotics.

[20]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[21]  Monica Gori,et al.  Better manipulation with human inspired tactile sensing , 2009 .

[22]  Michael Beetz,et al.  Perception for mobile manipulation and grasping using active stereo , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[23]  Joseph M. Romano,et al.  Toward tactilely transparent gloves: Collocated slip sensing and vibrotactile actuation , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[24]  Matei T. Ciocarlie,et al.  Contact-reactive grasping of objects with partial shape information , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Jürgen Sturm,et al.  Tactile object class and internal state recognition for mobile manipulation , 2010, 2010 IEEE International Conference on Robotics and Automation.

[26]  Robert D. Howe,et al.  Contact sensing and grasping performance of compliant hands , 2010, Auton. Robots.

[27]  Advait Jain,et al.  EL-E: an assistive mobile manipulator that autonomously fetches objects from flat surfaces , 2010, Auton. Robots.