Direct perception and action system for unknown object grasping

This paper discusses the direct perception for grasping and the action for perception using depth sensor. The previous method should recognize the accurate physical parameters to grasp an unknown object. Hence, we propose a sensation based perception which perceives exclusively the relevant information to the behavior of the robot. To perceive an unknown object, we have proposed the plane detection based approach of the SPD-SE. The SPD-SE may have applicability to robot perception at real time, and has advantages that the point group and properties of an unknown object can be extracted at the same time. The sensation of grasping is explained by inertia tensor and fuzzy inference. The sensation of grasping affords the possibility of action to a robot directly without inference from physical information such as size, posture and shape. As experimental results, we show that the robot can detect a relevant information of a grasping behavior directly. And, the sensation of grasping presents own state and environmental state together by one parameter.

[1]  Dejan Pangercic,et al.  Robotic roommates making pancakes , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[2]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[3]  Rolf Adams,et al.  Seeded Region Growing , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Michael Lehmann,et al.  An all-solid-state optical range camera for 3D real-time imaging with sub-centimeter depth resolution (SwissRanger) , 2004, SPIE Optical Systems Design.

[5]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[6]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[7]  Nak Young Chong,et al.  Knowledge Distributed Robot Control Framework , 2003 .

[8]  Jiri Matas,et al.  Matching with PROSAC - progressive sample consensus , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Erik Kjems,et al.  Automatic 3D building reconstruction from airbornelaser scanning and cadastral data using hough transform , 2004 .

[10]  Michel Dhome,et al.  Real time 3D template matching , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[11]  Fumio Harashima,et al.  Natural Interface Using Pointing Behavior for Human–Robot Gestural Interaction , 2007, IEEE Transactions on Industrial Electronics.

[12]  Hiroshi Ishiguro,et al.  What makes people accept a robot in a social environment - discussion from six-week study in an office - , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Gonzalo E. Reyes,et al.  The Logical Foundations of Cognition , 1994 .

[14]  Andreas Zell,et al.  Real-time plane extraction from depth images with the Randomized Hough Transform , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[15]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[16]  Naoyuki Kubota,et al.  Control Architecture for Human Friendly Robots Based on Interacting with Human , 2011, ICIRA.

[17]  E. Kjems,et al.  Automatic 3D building reconstruction from airbornelaser scanning and cadastral data using hough transform , 2004 .

[18]  Zoltan-Csaba Marton,et al.  Tutorial: Point Cloud Library: Three-Dimensional Object Recognition and 6 DOF Pose Estimation , 2012, IEEE Robotics & Automation Magazine.

[19]  Hun-ok Lim,et al.  3D plane detection for robot perception applying particle swarm optimization , 2014, 2014 World Automation Congress (WAC).

[20]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[21]  Hirochika Inoue.  Robot Projects for EXPO 2005 , 2006 .

[22]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .

[23]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).