Telemanipulation with Chopsticks: Analyzing Human Factors in User Demonstrations

Chopsticks constitute a simple yet versatile tool that humans have used for thousands of years to perform a variety of challenging tasks ranging from food manipulation to surgery. Applying such a simple tool in a diverse repertoire of scenarios requires significant adaptability. Towards developing autonomous manipulators with comparable adaptability to humans, we study chopsticks-based manipulation to gain insights into human manipulation strategies. We conduct a within-subjects user study with 25 participants, evaluating three different data-collection methods: normal chopsticks, motion-captured chopsticks, and a novel chopstick telemanipulation interface. We analyze factors governing human performance across a variety of challenging chopstick-based grasping tasks. Although participants rated teleoperation as the least comfortable and most difficult-to-use method, teleoperation enabled users to achieve the highest success rates on three out of five objects considered. Further, we notice that subjects quickly learned and adapted to the teleoperation interface. Finally, while motion-captured chopsticks could provide a better reflection of how humans use chopsticks, the teleoperation interface can produce quality on-hardware demonstrations from which the robot can directly learn.

[1]  Robert D. Howe,et al.  A compliant, underactuated hand for robust manipulation , 2013, Int. J. Robotics Res..

[2]  Kelvin E. Jones,et al.  Sources of signal-dependent noise during isometric force production. , 2002, Journal of neurophysiology.

[3]  Kenji Kawashima,et al.  Thin-diameter chopsticks robot for Laparoscopic Surgery , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[4]  M. Terauchi,et al.  Execution and description of dexterous hand task by using multi-finger dual robot hand system - realization of Japanese sign language , 2002, Proceedings of the IEEE Internatinal Symposium on Intelligent Control.

[5]  Makoto Kaneko,et al.  Robot Hands , 2008, Springer Handbook of Robotics.

[6]  Shyh-Jen Wang,et al.  The pincer chopsticks: the investigation of a new utensil in pinching function. , 2007, Applied ergonomics.

[7]  Aude Billard,et al.  Learning from Humans , 2016, Springer Handbook of Robotics, 2nd Ed..

[8]  Siddhartha S. Srinivasa,et al.  Towards Robotic Feeding: Role of Haptics in Fork-Based Food Manipulation , 2018, IEEE Robotics and Automation Letters.

[9]  Kostas J. Kyriakopoulos,et al.  Open-source, affordable, modular, light-weight, underactuated robot hands , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Akira Yamazaki,et al.  Autonomous Foods Handling by Chopsticks for Meal Assistant Robot , 2012, ROBOTIK.

[11]  Siddhartha S. Srinivasa,et al.  Generality and Simple Hands , 2009, ISRR.

[12]  Siddhartha S. Srinivasa,et al.  Manipulation Capabilities with Simple Hands , 2010, ISER.

[13]  Matthew A. Robertson,et al.  New soft robots really suck: Vacuum-powered systems empower diverse capabilities , 2017, Science Robotics.

[14]  Kostas J. Kyriakopoulos,et al.  Open-source, anthropomorphic, underactuated robot hands with a selectively lockable differential mechanism: Towards affordable prostheses , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Ahmed A. Ramadan,et al.  Developmental Process of a Chopstick-Like Hybrid-Structure Two-Fingered Micromanipulator Hand for 3-D Manipulation of Microscopic Objects , 2009, IEEE Transactions on Industrial Electronics.

[16]  Emanuel Todorov,et al.  Design of a highly biomimetic anthropomorphic robotic hand towards artificial limb regeneration , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Harry E. Stephanou,et al.  Chopstick manipulation with an articulated hand-a qualitative analysis , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[18]  Fumiya Iida,et al.  A Biologically Inspired Soft Robotic Hand Using Chopsticks for Grasping Tasks , 2016, SAB.

[19]  Kimitoshi Yamazaki,et al.  Recognition and manipulation integration for a daily assistive robot working on kitchen environments , 2010, 2010 IEEE International Conference on Robotics and Biomimetics.

[20]  Stefan Schaal,et al.  Skill learning and task outcome prediction for manipulation , 2011, 2011 IEEE International Conference on Robotics and Automation.

[21]  Manuela Veloso,et al.  Robot-driven Trajectory Improvement for Feeding Tasks , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[22]  George Boiadjiev,et al.  A learning control algorithm with experiments on a chopsticks robot , 2009 .

[23]  Heinrich M. Jaeger,et al.  Universal robotic gripper based on the jamming of granular material , 2010, Proceedings of the National Academy of Sciences.