A review of the challenges in mobile manipulation: systems design and RoboCup challenges

Mobile robotics is already well established in today’s production lines. Navigation, control and perception for mobile robots are vivid fields of research fostering advances in Industry 4.0. In order to increase the flexibility of such mobile platforms, it is also common practice to add serial manipulator arms to their yielding systems with nine degrees of freedom and more. These platforms are not limited to industry but are supportive in various field such as service, assistance, teleoperation and also rehabilitation. Due to the operation of such increasingly complex systems in less structured and dynamic environments - often in close contact with humans - more demanding challenges evolve in terms of systems design, control and sensors. These challenges are also reflected in the various RoboCup leagues. In this paper, we discuss state-of-the-art developments in mobile manipulation using developments and work done in the context of the RoboCup competition as design examples. Additionally, we elaborate on the recent challenges of the RoboCup Rescue League as well as on the RoboCup@Work League.

[1]  J. Gerstmayr,et al.  Komfortzone mobiler Manipulatoren , 2020 .

[2]  Hong Liu,et al.  DLR hand II: experiments and experience with an anthropomorphic hand , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[3]  Hiroaki Kitano,et al.  RoboCup: The Robot World Cup Initiative , 1997, AGENTS '97.

[4]  An Yuming,et al.  Survey on Key Technology of Robocup Rescue Robot , 2019, 2019 Chinese Control Conference (CCC).

[5]  Thomas Reisinger,et al.  Example Application of ISO/TS 15066 to a Collaborative Assembly Scenario , 2016 .

[6]  Christian Duriez,et al.  A Model-Based Sensor Fusion Approach for Force and Shape Estimation in Soft Robotics , 2020, IEEE Robotics and Automation Letters.

[7]  Alessandro Gasparetto,et al.  Path Planning and Trajectory Planning Algorithms: A General Overview , 2015 .

[8]  Mathias Brandstötter,et al.  Singularity Avoidance Control of a Non-Holonomic Mobile Manipulator for Intuitive Hand Guidance , 2019, Robotics.

[9]  Bing Qiao,et al.  Kinematic Model of a Four Mecanum Wheeled Mobile Robot , 2015 .

[10]  Alexander Ferrein,et al.  20 Years of RoboCup , 2016, KI - Künstliche Intelligenz.

[11]  Stephen A. Brewster,et al.  Sensory substitution using tactile pin arrays: Human factors, technology and applications , 2006, Signal Process..

[12]  Kazuya Yoshida,et al.  Path following control for tracked vehicles based on slip-compensating odometry , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Hubert Zangl,et al.  Contactless Control of a Kinematically Redundant Serial Manipulator Using Tomographic Sensors , 2017, IEEE Robotics and Automation Letters.

[14]  Adam Jacoff,et al.  RoboCup Rescue Robot and Simulation Leagues , 2012, AI Mag..

[15]  Oussama Khatib,et al.  Springer Handbook of Robotics , 2007, Springer Handbooks.

[16]  Mina A. S. Aziz,et al.  Simulation of a three-links planar redundant manipulator for obstacle avoidance using neural networks , 2016, 2016 IEEE Industrial Electronics and Applications Conference (IEACon).

[17]  Luigi Villani,et al.  A Conformable Force/Tactile Skin for Physical Human–Robot Interaction , 2016, IEEE Robotics and Automation Letters.

[18]  Kevin M. Lynch,et al.  Modern Robotics: Mechanics, Planning, and Control , 2017 .

[19]  M. Husty,et al.  A new and efficient algorithm for the inverse kinematics of a general serial 6R manipulator , 2007 .

[20]  Pasquale Chiacchio,et al.  The dynamic manipulability ellipsoid for redundant manipulators , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[21]  Turki Owaid Aienizi,et al.  Trajectory Tracking of Wheeled Mobile Robot using Adaptive Second Order Sliding Mode Controller , 2019, 2019 6th International Conference on Control, Decision and Information Technologies (CoDIT).

[22]  Sadao Kawamura,et al.  Advances in Robot Control , 2006 .

[23]  Ching-Chih Tsai,et al.  Adaptive Trajectory Tracking and Stabilization for Omnidirectional Mobile Robot with Dynamic Effect , 2008 .

[24]  Md. Golam Rashed,et al.  Recognizing Gaze Pattern for Human Robot Interaction , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[25]  Christof Röhrig,et al.  Motion controller design for a mecanum wheeled mobile manipulator , 2017, 2017 IEEE Conference on Control Technology and Applications (CCTA).

[26]  Frederik Hegger,et al.  RoboCup@Work: Competing for the Factory of the Future , 2014, RoboCup.

[27]  Myo-Taeg Lim,et al.  3D vision based local obstacle avoidance method for humanoid robot , 2012, 2012 12th International Conference on Control, Automation and Systems.

[28]  Alin Albu-Schaffer,et al.  Study on Soft-Tissue Injury in Robotics , 2011, IEEE Robotics & Automation Magazine.

[29]  Hubert Zangl,et al.  Design of a Novel Gripper System with 3D- and Inkjet-printed Multimodal Sensors for Automated Grasping of a Forestry Robot , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[30]  Aiguo Song,et al.  Designed and implementation of a semi-autonomous search robot , 2009, 2009 International Conference on Mechatronics and Automation.

[31]  Huaizhong Li,et al.  Gradient-guided color image contrast and saturation enhancement , 2017 .

[32]  Antonio Bicchi,et al.  Choosing Poses for Force and Stiffness Control , 2017, IEEE Transactions on Robotics.

[33]  Hubert Zangl,et al.  Rapid prototyping of force/pressure sensors using 3D- and inkjet-printing , 2018, Journal of Micromechanics and Microengineering.

[34]  Hubert Zangl,et al.  Gesture-based Contactless Control of Mobile Manipulators using Capacitive Sensing , 2020, 2020 IEEE International Instrumentation and Measurement Technology Conference (I2MTC).

[35]  Ilse Ravyse,et al.  Working with Walt: How a Cobot Was Developed and Inserted on an Auto Assembly Line , 2018, IEEE Robotics & Automation Magazine.

[36]  Ilya Afanasyev,et al.  Comparison of Various SLAM Systems for Mobile Robot in an Indoor Environment , 2018, 2018 International Conference on Intelligent Systems (IS).

[37]  Spyros G. Tzafestas,et al.  Introduction to Mobile Robot Control , 2013 .

[38]  F. Carpi,et al.  Soft dielectrics for capacitive sensing in robot skins: Performance of different elastomer types , 2015 .

[39]  Chih-Cheng Chen,et al.  A combined optimization method for solving the inverse kinematics problems of mechanical manipulators , 1991, IEEE Trans. Robotics Autom..

[40]  Jean Scholtz,et al.  Common metrics for human-robot interaction , 2006, HRI '06.

[41]  Luka Petrovic,et al.  Motion planning in high-dimensional spaces , 2018, ArXiv.

[42]  Robin Dietrich,et al.  Deep Learning-Based Mutual Detection and Collaborative Localization for Mobile Robot Fleets Using Solely 2D LIDAR Sensors , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[43]  Tsuneo Yoshikawa,et al.  Manipulability of Robotic Mechanisms , 1985 .

[44]  Panagiotis Polygerinos,et al.  Soft Poly-Limbs: Toward a New Paradigm of Mobile Manipulation for Daily Living Tasks. , 2019, Soft robotics.

[45]  Byung Kook Kim,et al.  Minimum-energy cornering trajectory planning with self-rotation for three-wheeled omni-directional mobile robots , 2017 .

[46]  Quoc V. Le,et al.  High-accuracy 3D sensing for mobile manipulation: Improving object detection and door opening , 2009, 2009 IEEE International Conference on Robotics and Automation.

[47]  Hubert Zangl,et al.  An All-Flexible Sensing Sole For Legged Robots , 2019, 2019 IEEE International Conference on Flexible and Printable Sensors and Systems (FLEPS).

[48]  M. Pivtoraiko,et al.  A Classification of Configuration Spaces of Planar Robot Arms for a Continuous Inverse Kinematics Problem , 2015 .

[49]  Alin Albu-Schäffer,et al.  The KUKA-DLR Lightweight Robot arm - a new reference platform for robotics research and manufacturing , 2010, ISR/ROBOTIK.

[50]  Lih-Chang Lin,et al.  Modeling and Adaptive Control of an Omni-Mecanum-Wheeled Robot , 2013 .

[51]  Hubert Zangl,et al.  Inkjet-printing rapid prototyping of a robust and flexible capacitive touch panel , 2016, 2016 IEEE SENSORS.

[52]  Fredrik Rehnmark,et al.  Robonaut: NASA's Space Humanoid , 2000, IEEE Intell. Syst..

[53]  Wei Zheng,et al.  Multi-layer Feed-forward Neural Network Deep Learning Control with Hybrid Position and Virtual-force Algorithm for Mobile Robot Obstacle Avoidance , 2019, International Journal of Control, Automation and Systems.

[54]  Kazuya Yoshida,et al.  Semi-autonomous operation of tracked vehicles on rough terrain using autonomous control of active flippers , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[55]  Paolo Fiorini,et al.  Service robotics (the rise and bloom of service robots) [tc spotlight] , 2013, IEEE Robotics & Automation Magazine.

[56]  Mike Stilman,et al.  Global Manipulation Planning in Robot Joint Space With Task Constraints , 2010, IEEE Transactions on Robotics.

[57]  Rafael Kelly,et al.  Control of Robot Manipulators in Joint Space , 2005 .

[58]  Juan D. Tardós,et al.  ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras , 2016, IEEE Transactions on Robotics.

[59]  Tsuneo Yoshikawa,et al.  Analysis and Control of Articulated Robot Arms with Redundancy , 1981 .

[60]  Giorgio Metta,et al.  Methods and Technologies for the Implementation of Large-Scale Robot Tactile Sensors , 2011, IEEE Transactions on Robotics.

[61]  Joris De Schutter,et al.  Incorporating Artificial Skin Signals in the Constraint-based Reactive Control of Human-Robot Collaborative Manipulation Tasks , 2018, 2018 3rd International Conference on Advanced Robotics and Mechatronics (ICARM).

[62]  Alexander Ferrein,et al.  20 Years of RoboCup , 2016, KI - Künstliche Intelligenz.

[63]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[64]  Jean-Claude Latombe,et al.  Robot motion planning , 1970, The Kluwer international series in engineering and computer science.

[65]  Yue Wang,et al.  Collaborative Assembly in Hybrid Manufacturing Cells: An Integrated Framework for Human–Robot Interaction , 2018, IEEE Transactions on Automation Science and Engineering.

[66]  G. Dissanayake,et al.  Robotics for Urban Search and Rescue , 2006, First International Conference on Industrial and Information Systems.

[67]  Katina Michael,et al.  The Packbots Are Coming: Boosting security at the 2014 FIFA World Cup. , 2014, IEEE Consumer Electronics Magazine.

[68]  Sen Wang,et al.  Learning Mobile Manipulation through Deep Reinforcement Learning , 2020, Sensors.

[69]  Kazunori Ohno,et al.  Semi-autonomous control of 6-DOF crawler robot having flippers for getting over unknown-steps , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[70]  Jianwei Zhang,et al.  Grasping Force Control of Multi-Fingered Robotic Hands through Tactile Sensing for Object Stabilization , 2020, Sensors.

[71]  Tadej Petrič,et al.  Obstacle Avoidance for Redundant Manipulators as Control Problem , 2012 .

[72]  Spyros G. Tzafestas,et al.  Mobile Robot Control and Navigation: A Global Overview , 2018, Journal of Intelligent & Robotic Systems.

[73]  Roman Weitschat,et al.  End-effector airbags to accelerate human-robot collaboration , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[74]  Matthias Scheutz,et al.  Is robot telepathy acceptable? Investigating effects of nonverbal robot-robot communication on human-robot interaction , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[75]  Chih-Min Lin,et al.  A Developmental Learning Approach of Mobile Manipulator via Playing , 2017, Front. Neurorobot..

[76]  Haibin Yin,et al.  A unified design for lightweight robotic arms based on unified description of structure and drive trains , 2017 .

[77]  Martin Vossiek,et al.  A Rotating Synthetic Aperture Radar Imaging Concept for Robot Navigation , 2014, IEEE Transactions on Microwave Theory and Techniques.

[78]  Akiya Kamimura,et al.  Technology evaluations of personal mobility vehicles in Tsukuba-city mobility robot designated zone — An experimental approach for personal mobility for sharing , 2014, 2014 International Conference on Connected Vehicles and Expo (ICCVE).

[79]  Tsuneo Yoshikawa,et al.  Dynamic Manipulability of Robot Manipulators , 1985 .

[80]  Abhijit Makhal,et al.  Reuleaux: Robot Base Placement by Reachability Analysis , 2017, 2018 Second IEEE International Conference on Robotic Computing (IRC).

[81]  Zeungnam Bien,et al.  Adaptive motion/force control of multiple manipulators with joint flexibility based on virtual decomposition , 1998 .

[82]  Michael Pieber,et al.  An Adaptive Robot for Building In-Plane Programmable Structures , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[83]  Fulvio Mastrogiovanni,et al.  Special issue on advances in tactile sensing and tactile-based human-robot interaction , 2015, Robotics Auton. Syst..

[84]  Mark R. Cutkosky,et al.  Capacitive Sensing for a Gripper With Gecko-Inspired Adhesive Film , 2019, IEEE Robotics and Automation Letters.

[85]  Pedro Fernandes,et al.  Autonomous 4DOF Robotic Manipulator Prototype for Industrial Environment and Human Cooperation , 2019, 2019 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[86]  Gerald Steinbauer,et al.  Novel rule set for the RoboCup rescue robot league , 2016, 2016 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[87]  Bingyin Ren,et al.  A Method on Dynamic Path Planning for Robotic Manipulator Autonomous Obstacle Avoidance Based on an Improved RRT Algorithm , 2018, Sensors.

[88]  Harald van der Werff,et al.  The Influence of Surface Topography on the Weak Ground Shaking in Kathmandu Valley during the 2015 Gorkha Earthquake, Nepal , 2020, Sensors.

[89]  Joel W. Burdick,et al.  Proprioceptive Inference for Dual-Arm Grasping of Bulky Objects Using RoboSimian , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[90]  Antonio Bicchi,et al.  A truly safely moving robot has to know what injury it may cause , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[91]  Timothy Bretl,et al.  Kinematic and dynamic control of a wheeled mobile robot , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.