Integrated control of a multiple-degree-of-freedom hand and arm using a reactive architecture based on high-speed proximity sensing

We describe integrated control of a multiple-degree-of-freedom hand and arm using a simple reactive architecture based on high-speed proximity sensing. A proximity sensor installed on each fingertip of the hand detects the positions between the sensor and the surface of an object. By feeding back the sensor outputs, the reactive architecture simultaneously controls the position of the arm tip and the vector connecting the grasping position and the origin of the arm tip coordinates, the wrist posture, and the initial finger configurations before grasping. This architecture makes it possible to correct position errors. In addition, since the positions and postures are controlled without contact, there is no danger of damaging the object or the robot. To realize this integrated control using a simple reactive architecture, we designed a high-speed proximity sensor for the fingertips of the hand, and developed an integrated control system for the hand and the arm. We demonstrate high-speed position adjustment motion and grasping for static and moving objects in experiments.

[1]  Oliver Kroemer,et al.  Combining active learning and reactive control for robot grasping , 2010, Robotics Auton. Syst..

[2]  John Kenneth Salisbury,et al.  An Optical Fiber Proximity Sensor for Haptic Exploration , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[3]  Antal K. Bejczy,et al.  Planning Considerations for a Roving Robot with Arm , 1973, IJCAI.

[4]  Danica Kragic,et al.  Data-Driven Grasp Synthesis—A Survey , 2013, IEEE Transactions on Robotics.

[5]  J. W. Hill,et al.  Manipulation based on sensor-directed control: An integrated end effector and touch sensing system , 1973 .

[6]  A. R. Johnston Proximity sensor technology for manipulator end effectors , 1977 .

[7]  Shigeki Toyama,et al.  Development of a five-finger dexterous hand without feedback control: The TUAT/Karlsruhe humanoid hand , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Robert D. Howe,et al.  Limits to compliance and the role of tactile sensing in grasping , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Michael A. Saliba,et al.  The mechanical and control system design of a dexterous robotic gripper , 2001, ICECS 2001. 8th IEEE International Conference on Electronics, Circuits and Systems (Cat. No.01EX483).

[10]  Robert D. Howe,et al.  The Highly Adaptive SDM Hand: Design and Performance Evaluation , 2010, Int. J. Robotics Res..

[11]  Kaspar Althoefer,et al.  Force and proximity fingertip sensor to enhance grasping perception , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Di Guo,et al.  Transmissive optical pretouch sensing for robotic grasping , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  Joshua R. Smith,et al.  An Electric Field Pretouch system for grasping and co-manipulation , 2010, 2010 IEEE International Conference on Robotics and Automation.

[14]  Masayuki Inaba,et al.  Picking up dishes based on active groping with multisensory robot hand , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[15]  Kaspar Althoefer,et al.  Fingertip proximity sensor with realtime visual-based calibration , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[16]  Kazuhiro Shimonomura,et al.  Robotic grasp control with high-resolution combined tactile and proximity sensing , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Marek Teichmann,et al.  Reactive Robotics I: Reactive Grasping with a Modified Gripper and Multifingered Hands , 2000, Int. J. Robotics Res..

[18]  Matei T. Ciocarlie,et al.  Contact-reactive grasping of objects with partial shape information , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Heinrich M. Jaeger,et al.  Universal robotic gripper based on the jamming of granular material , 2010, Proceedings of the National Academy of Sciences.

[20]  Oliver Brock,et al.  A compliant hand based on a novel pneumatic actuator , 2013, 2013 IEEE International Conference on Robotics and Automation.

[21]  Aiguo Ming,et al.  Net-Structure Proximity Sensor: High-Speed and Free-Form Sensor With Analog Computing Circuit , 2015, IEEE/ASME Transactions on Mechatronics.

[22]  Aiguo Ming,et al.  Pre-shaping for various objects by the robot hand equipped with resistor network structure proximity sensors , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Tanja Schultz,et al.  Telemanipulation with force-based display of proximity fields , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[24]  AmendJohn,et al.  Soft Robotics Commercialization: Jamming Grippers from Research to Product. , 2016 .

[25]  Aiguo Ming,et al.  Grasping strategy for moving object using Net-Structure Proximity Sensor and vision sensor , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[26]  Antal K. Bejczy Effect of hand-based sensors on manipulator control performance , 1977 .

[27]  Kenji Suzuki,et al.  Robust robotic grasping using IR Net-Structure Proximity Sensor to handle objects with unknown position and attitude , 2013, 2013 IEEE International Conference on Robotics and Automation.

[28]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[29]  Ashutosh Saxena,et al.  Reactive grasping using optical proximity sensors , 2009, 2009 IEEE International Conference on Robotics and Automation.

[30]  Heinz Wörn,et al.  6D proximity servoing for preshaping and haptic exploration using capacitive tactile proximity sensors , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Joshua R. Smith,et al.  Seashell effect pretouch sensing for robotic grasping , 2012, 2012 IEEE International Conference on Robotics and Automation.

[32]  Gordon Cheng,et al.  Humanoid Multimodal Tactile-Sensing Modules , 2011, IEEE Transactions on Robotics.

[33]  Vladimir J. Lumelsky,et al.  A sensitive skin system for motion control of robot arm manipulators , 1992, Robotics Auton. Syst..

[34]  A K Bejczy,et al.  Sensors, Controls, and Man-Machine Interface for Advanced Teleoperation , 1980, Science.

[35]  Aiguo Ming,et al.  Integrated control of a multi-fingered hand and arm using proximity sensors on the fingertips , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[36]  Aiguo Ming,et al.  Development of intelligent robot hand using proximity, contact and slip sensing , 2010, 2010 IEEE International Conference on Robotics and Automation.

[37]  Nikolaus Correll,et al.  Integrated force and distance sensing using elastomer-embedded commodity proximity sensors , 2016, Robotics: Science and Systems.