Kinect-based robotic manipulation for door opening

A general framework of robot manipulation planning for door opening task is proposed in this paper. First grasp pattern, including grasp point and method for various door handles, is defined. Second door-opening pattern, including task planning and trajectory planning, is also proposed. This paper utilizes Kinect as a vision sensor to collect point cloud data of the environment. Viewpoint Feature Histogram (VFH) descriptors are used to recognize the type of the door handle. Then corresponding parameters of grasp pattern and door-opening pattern are extracted using Point Cloud processing algorithms. The robot follows the corresponding grasp pattern to grasp the door handle and repeats the motion trajectory to finish each sub operation. Two experiments were conducted to validate the proposed framework.

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  John K. Tsotsos,et al.  Active Vision for Door Localization and Door Opening using Playbot: A Computer Controlled Wheelchair for People with Mobility Impairments , 2008, 2008 Canadian Conference on Computer and Robot Vision.

[3]  Radu Bogdan Rusu,et al.  Semantic 3D Object Maps for Everyday Manipulation in Human Living Environments , 2010, KI - Künstliche Intelligenz.

[4]  Ashutosh Saxena,et al.  Learning to open new doors , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Kurt Konolige,et al.  Autonomous door opening and plugging in with a personal robot , 2010, 2010 IEEE International Conference on Robotics and Automation.

[6]  Eugen Hoffmann,et al.  Visually and Force Controlled Opening and Closing of Doors by Means of a Mobile Robot Arm , 2012, ROBOTIK.

[7]  Qingming Zhana,et al.  Color-based Segmentation of Point Clouds , 2009 .

[8]  Gary R. Bradski,et al.  Fast 3D recognition and pose using the Viewpoint Feature Histogram , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Dejan Pangercic,et al.  A generalized framework for opening doors and drawers in kitchen environments , 2012, 2012 IEEE International Conference on Robotics and Automation.

[10]  Thomas A. Funkhouser,et al.  Min-cut based segmentation of point clouds , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[11]  James A. Hendler,et al.  HTN Planning: Complexity and Expressivity , 1994, AAAI.

[12]  Heinz Wörn,et al.  Opening a door with a humanoid robot using multi-sensory tactile feedback , 2008, 2008 IEEE International Conference on Robotics and Automation.