Reliable hand camera based book detection and manipulation in library scenario

In this paper a new approach for detection, grasping and placing of books is described. The location as well as book's size, color and textures are unknown. Therefore the autonomous book detection and grasping is a big challenge. In this work, the proposed approach is implemented in the scope of a library scenario in which a service robotic system operates. The proposed approach uses stereo vision for coarse approach to the next book, which should be grasped, and a hand camera (mounted on the gripper) based positioning strategy to achieve a high success rate of grasping. The full concept was implemented and tested on the service robot FRIEND. It should support a handicapped person to work and to perform all manipulative tasks. These contain the autonomous book detection on a book cart, the grasping and placing of the book on a book holder and later onto the cart again. The benefit of our approach is documented based on experimental results.

[1]  Shin'ichi Yuta,et al.  Remote book browsing system using a mobile manipulator , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[2]  A. Graser,et al.  Low level control in a semi-autonomous rehabilitation robotic system via a Brain-Computer Interface , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[3]  Oliver Prenzel.  Process model for the development of semi-autonomous service robots , 2009 .

[4]  Angel P. del Pobil,et al.  The UJI librarian robot , 2008, Intell. Serv. Robotics.

[5]  José Manuel Iñesta Quereda,et al.  Vision-guided grasping of unknown objects for service robots , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[6]  Axel Gräser,et al.  A BCI-controlled robotic assistant for quadriplegic people in domestic and professional life , 2011, Robotica.

[7]  Danijela Ristic-Durrant,et al.  ROVIS: Robust machine vision for service robotic system FRIEND , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Axel Gräser,et al.  A RRT based path planning algorithm for Rehabilitation robots , 2010, ISR/ROBOTIK.

[9]  Shin'ichi Yuta,et al.  Book browsing system using an autonomous mobile robot teleoperated via the internet , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Kosei Kitagaki,et al.  Design and Control of Librarian Robot System in Information Structured Environments , 2009, J. Robotics Mechatronics.

[11]  A. Leonardi,et al.  BOOK RECOGNITION AS AN EXAMPLE OF FLAT AND STRUCTURED OBJECTS CLASSIFICATION , 1995 .

[12]  Gregory S. Chirikjian,et al.  A robotic library system for an off-site shelving facility , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[13]  Pedro J. Sanz,et al.  An autonomous assistant robot for book manipulation in a library , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[14]  Shin'ichi Yuta,et al.  Object posture recognition for remote book browsing robot system , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).