The UJI librarian robot

This paper describes the UJI librarian robot, a mobile manipulator that is able to autonomously locate a book in an ordinary library, and grasp it from a bookshelf, by using eye-in-hand stereo vision and force sensing. The robot is only provided with the book code, a library map and some knowledge about its logical structure and takes advantage of the spatio-temporal constraints and regularities of the environment by applying disparate techniques such as stereo vision, visual tracking, probabilistic matching, motion estimation, multisensor-based grasping, visual servoing and hybrid control, in such a way that it exhibits a robust and dependable performance. The system has been tested, and experimental results show how it is able to robustly locate and grasp a book in a reasonable time without human intervention.

[1]  Howie Choset,et al.  Principles of Robot Motion: Theory, Algorithms, and Implementation ERRATA!!!! 1 , 2007 .

[2]  Lino Bort,et al.  Using speech to guide a mobile robot manipulator , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[3]  David G. Lowe,et al.  Robust model-based motion tracking through the integration of search and estimation , 1992, International Journal of Computer Vision.

[4]  Fadi Dornaika,et al.  Visually guided object grasping , 1998, IEEE Trans. Robotics Autom..

[5]  Matthew T. Mason,et al.  Compliance and Force Control for Computer Controlled Manipulators , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[6]  F. Marrone.  Compliant Interaction of a Domestic Service Robot with a Human and the Environment , 2002 .

[7]  Ulrike Thomas,et al.  Compliant motion programming: The task frame formalism revisited , 2004 .

[8]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[9]  Angel P. del Pobil,et al.  Spatial Representation and Motion Planning , 1995, Lecture Notes in Computer Science.

[10]  Joris De Schutter,et al.  Integrated Vision/Force Robotic Servoing in the Task Frame Formalism , 2003, Int. J. Robotics Res..

[11]  Angel P. del Pobil,et al.  Towards multipurpose autonomous manipulation with the UJI service robot , 2007, Robotica.

[12]  Gregory S. Chirikjian,et al.  An Enhanced Robotic Library System for an Off-Site Shelving Facility , 2003, FSR.

[13]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[14]  Minoru Asada,et al.  Adaptive hybrid visual servoing/force control in unknown environment , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[15]  J. De Schutter,et al.  Compliant Robot Motion I. A Formalism for Specifying Compliant Motion Tasks , 1988 .

[16]  Larry S. Davis,et al.  Probabilistic tracking in joint feature-spatial spaces , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[17]  Shin'ichi Yuta,et al.  Remote book browsing system using a mobile manipulator , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[18]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[19]  G. Morel,et al.  Impedance based combination of visual and force control , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).