System architecture for autonomous mobile manipulation of everyday objects in domestic environments

Assistive service robots have a great potential for helping elderly or motor-impaired people in everyday tasks. Specifically, enabling robots to manipulate objects in home environments is a critical step towards independent life. In this work, we focus on developing a complete system for autonomous mobile manipulation. We describe our system, which consists of natural language processing, perception, navigation, and integrated motion and grasp planning modules.

[1]  Maya Cakmak,et al.  Towards a comprehensive chore list for domestic robots , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[2]  Advait Jain,et al.  EL-E: an assistive mobile manipulator that autonomously fetches objects from flat surfaces , 2010, Auton. Robots.

[3]  Wolfram Burgard,et al.  The dynamic window approach to collision avoidance , 1997, IEEE Robotics Autom. Mag..

[4]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[5]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[6]  Chih-Hung King,et al.  Dusty: an assistive mobile manipulator that retrieves dropped objects for people with motor impairments , 2011, Disability and rehabilitation. Assistive technology.

[7]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[8]  S. Sathiya Keerthi,et al.  A fast procedure for computing the distance between complex objects in three-dimensional space , 1988, IEEE J. Robotics Autom..

[9]  Matei T. Ciocarlie,et al.  Mobile manipulation through an assistive home robot , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Byron Boots,et al.  One-Shot Learning for Semantic Segmentation , 2017, BMVC.

[11]  Faouzi Ghorbel,et al.  A simple and efficient approach for 3D mesh approximate convex decomposition , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[12]  Geoffrey A. Hollinger,et al.  HERB: a home exploring robotic butler , 2010, Auton. Robots.

[13]  James J. Kuffner,et al.  OpenRAVE: A Planning Architecture for Autonomous Robotics , 2008 .

[14]  Wojciech Zaremba,et al.  Domain randomization for transferring deep neural networks from simulation to the real world , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Taskin Padir,et al.  A Comparative Analysis of Contact Models in Trajectory Optimization for Manipulation* , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[16]  Stefan Kohlbrecher,et al.  A flexible and scalable SLAM system with full 3D motion estimation , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[17]  Nico Blodow,et al.  Towards 3D Point cloud based object maps for household environments , 2008, Robotics Auton. Syst..

[18]  Luca Iocchi,et al.  RoboCup@Home: Scientific Competition and Benchmarking for Domestic Service Robots , 2009 .

[19]  Pieter Abbeel,et al.  Motion planning with sequential convex optimization and convex collision checking , 2014, Int. J. Robotics Res..

[20]  Taskin Padir,et al.  User-centric design of a personal assistance robot (FRASIER) for active aging , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[21]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[22]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[23]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.