ALTERNATIVE AND FLEXIBLE CONTROL METHODS FOR ROBOTIC MANIPULATORS: On the challenge of developing a flexible control architecture that allows for controlling different manipulators

Robotic arms and cranes show some similarities in the way they operate and in the way they are designed. Both have a number of links serially attached to each other by means of joints that can be moved by some type of actuator. In both systems, the end-effector of the manipulator can be moved in space and be placed in any desired location within the system’s workspace and can carry a certain amount of load. However, traditional cranes are usually relatively big, stiff and heavy because they normally need to move heavy loads at low speeds, while industrial robots are ordinarily smaller, they usually move small masses and operate at relatively higher velocities. This is the reason why cranes are commonly actuated by hydraulic valves, while robotic arms are driven by servo motors, pneumatic or servo-pneumatic actuators. Most importantly, the fundamental difference between the two kinds of systems is that cranes are usually controlled by a human operator, joint by joint, using simple joysticks where each axis operates only one specific actuator, while robotic arms are commonly controlled by a central controller that controls and coordinates the actuators according to some specific algorithm. In other words, the controller of a crane is usually a human while the controller of a robotic arm is normally a computer program that is able to determine the joint values that provide a desired position or velocity for the end-effector. If we especially consider maritime cranes, compared with robotic arms, they rely on a much more complex model of the environment with which they interact. These kinds of cranes are in fact widely used to handle and transfer objects from large container ships to smaller lighters or to the quays of the harbours. Therefore, their control is always a challenging task, which involves many problems such as load sway, positioning accuracy, wave motion compensation and collision avoidance. Some of the similarities between robotic arms and cranes can also be extended to robotic hands. Indeed, from a kinematic point of view, a robotic hand consists of one or more kinematic chains fixed on a base. However, robotic hands usually present a higher number of degrees of freedom (DOFs) and consequentially a higher dexterity compared to robotic arms. Nevertheless, several commonalities can be found from a design and control point of views. Particularly, modular robotic hands are studied in this thesis from a design and control point of view. Emphasising these similarities, the general term of robotic manipulator is thereby used to refer to robotic arms, cranes and hands. In this work, efficient design methods for robotic manipulators are initially investigated. Successively, the possibility of developing a flexible control architecture that allows for controlling different manipulators by using a universal input device is outlined. The main challenge of doing this consists of finding a flexible way to map the normally fixed DOFs of the input controller to the variable DOFs of the specific manipulator to be controlled. This process has to be realised regardless of the differences in size, kinematic structure, body morphology, constraints and affordances. Different alternative control algorithms are investigated including effective approaches that do not assume a priori knowledge for the Inverse Kinematic (IK) models. These algorithms derive the kinematic properties from biologically-inspired approaches, machine learning procedures or optimisation methods. In this way, the system is able to automatically learn the kinematic properties of different manipulators. Finally, a methodology for performing experimental activities in the area of maritime cranes and robotic arm control is outlined. By combining the rapid-prototyping approach with the concept of interchangeable interfaces, a simulation and benchmarking framework for advanced control methods of maritime cranes and robotic arms is presented.

[1]  John F. Canny,et al.  Planning optimal grasps , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[2]  Houxiang Zhang,et al.  Locomotion capabilities of a modular robot with eight pitch-yaw-connecting modules , 2006 .

[3]  Ali H. Nayfeh,et al.  Cargo Pendulation Reduction of Ship-Mounted Cranes , 2004 .

[4]  Rafael Aracil,et al.  Simplified human hand models based on grasping analysis , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Svante Gunnarsson,et al.  A Benchmark Problem for Robust Control of a Multivariable Nonlinear Flexible Manipulator , 2008 .

[6]  James J. Kuffner,et al.  OpenRAVE: A Planning Architecture for Autonomous Robotics , 2008 .

[7]  F. Sanfilippo,et al.  The new architecture of ModGrasp for mind-controlled low-cost sensorised modular hands , 2015, 2015 IEEE International Conference on Industrial Technology (ICIT).

[8]  Yingguang Chu,et al.  An effective heave compensation and anti-sway control approach for offshore hydraulic crane operations , 2014, 2014 IEEE International Conference on Mechatronics and Automation.

[9]  Matthias Schopfer,et al.  Open source real-time control software for the Kuka light weight robot , 2010, 2010 8th World Congress on Intelligent Control and Automation.

[10]  F. Leens,et al.  An introduction to I2C and SPI protocols , 2009, IEEE Instrumentation & Measurement Magazine.

[11]  Daniela Rus,et al.  Modular Robot Systems , 2010, IEEE Robotics & Automation Magazine.

[12]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[13]  Jianwei Zhang,et al.  Development of a low-cost flexible modular robot GZ-I , 2008, 2008 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[14]  F. Sanfilippo,et al.  JOpenShowVar: An open-source cross-platform communication interface to Kuka robots , 2014, 2014 IEEE International Conference on Information and Automation (ICIA).

[15]  Kristin Ytterstad Pettersen,et al.  Integrated Flexible Maritime Crane Architecture for the Offshore Simulation Centre AS (OSC): A Flexible Framework for Alternative Maritime Crane Control Algorithms , 2016, IEEE Journal of Oceanic Engineering.

[16]  Riccardo Poli,et al.  Analysis of the publications on the applications of particle swarm optimisation , 2008 .

[17]  Gordon G. Parker,et al.  Inverse Kinematic Control of a Dual Crane System Experiencing Base Motion , 2015, IEEE Transactions on Control Systems Technology.

[18]  Kristin Ytterstad Pettersen,et al.  A universal control architecture for maritime cranes and robots using genetic algorithms as a possible mapping approach , 2013, 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[19]  Jianqiang Yi,et al.  Anti-swing and positioning control of overhead traveling crane , 2003, Inf. Sci..

[20]  Aaron M. Dollar,et al.  A modular, open-source 3D printed underactuated hand , 2013, 2013 IEEE International Conference on Robotics and Automation.

[21]  Matei T. Ciocarlie,et al.  Hand Posture Subspaces for Dexterous Robotic Grasping , 2009, Int. J. Robotics Res..

[22]  Luca Iocchi,et al.  RoboCup@Home: Scientific Competition and Benchmarking for Domestic Service Robots , 2009 .

[23]  William Bolton 1 – Programmable logic controllers , 2006 .

[24]  Saptarshi Das,et al.  Tuning of an optimal fuzzy PID controller with stochastic algorithms for networked control systems with random time delay. , 2011, ISA transactions.

[25]  Francesco Chinello,et al.  KUKA Control Toolbox , 2011, IEEE Robotics & Automation Magazine.

[26]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[27]  Wen-Hong Zhu,et al.  Modular Robot Manipulators Based on Virtual Decomposition Control , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[28]  W. Oechel,et al.  Automatic design and manufacture of robotic lifeforms , 2022 .

[29]  Peter K. Allen,et al.  Graspit! A versatile simulator for robotic grasping , 2004, IEEE Robotics & Automation Magazine.

[30]  O Sawodny,et al.  Active Control for an Offshore Crane Using Prediction of the Vessel’s Motion , 2011, IEEE/ASME Transactions on Mechatronics.

[31]  Yin Yong Maritime Simulators: Convention and Technology , 2010 .

[32]  Alexander Zeier,et al.  Assessment of communication protocols in the EPC Network - replacing textual SOAP and XML with binary google protocol buffers encoding , 2010, 2010 IEEE 17Th International Conference on Industrial Engineering and Engineering Management.

[33]  Kristin Ytterstad Pettersen,et al.  ModGrasp: An open-source rapid-prototyping framework for designing low-cost sensorised modular hands , 2014, 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.

[34]  Andreas Angerer,et al.  On reverse-engineering the KUKA Robot Language , 2010, ArXiv.

[35]  R. Dubay,et al.  Telerobotic shipboard handling system , 1997, Oceans '97. MTS/IEEE Conference Proceedings.

[36]  J. F. Soechting,et al.  Postural Hand Synergies for Tool Use , 1998, The Journal of Neuroscience.

[37]  Frank Chongwoo Park,et al.  Optimal robot motions for physical criteria , 2001, J. Field Robotics.

[38]  Russell C. Eberhart,et al.  Tracking and optimizing dynamic systems with particle swarms , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[39]  Mark Yim,et al.  PolyBot: a modular reconfigurable robot , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[40]  Yangsheng Xu,et al.  PSO-Based Time-Optimal Trajectory Planning for Space Robot with Dynamic Constraints , 2006, 2006 IEEE International Conference on Robotics and Biomimetics.

[41]  Antonio Bicchi,et al.  On motion and force controllability of grasping hands with postural synergies , 2010, Robotics: Science and Systems.

[42]  Xiang Cheng,et al.  An approach for robot inverse velocity solution using genetic algorithm , 2004, Proceedings of 2004 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.04EX826).

[43]  T. Miyoshi,et al.  Operation assist control system of rotary crane using proposed haptic joystick as man-machine interface , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[44]  Kristin Ytterstad Pettersen,et al.  OpenMRH: A modular robotic hand generator plugin for OpenRAVE , 2015, 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[45]  Tingting Chen,et al.  Research on standardization of marine simulator training and assessment , 2011, 2011 IEEE 3rd International Conference on Communication Software and Networks.

[46]  A.M. Dollar,et al.  A robust compliant grasper via shape deposition manufacturing , 2006, IEEE/ASME Transactions on Mechatronics.

[47]  Chih-Han Yu,et al.  Self-adapting modular robotics: A generalized distributed consensus framework , 2009, 2009 IEEE International Conference on Robotics and Automation.

[48]  Adam Lipowski,et al.  Roulette-wheel selection via stochastic acceptance , 2011, ArXiv.

[49]  Joel W. Burdick,et al.  Determining task optimal modular robot assembly configurations , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[50]  Filippo Sanfilippo,et al.  Flexible Modeling And Simulation Architecture For Haptic Control Of Maritime Cranes And Robotic Arm , 2013, ECMS.

[51]  Monica Malvezzi,et al.  Mapping Synergies From Human to Robotic Hands With Dissimilar Kinematics: An Approach in the Object Domain , 2013, IEEE Transactions on Robotics.

[52]  Gregory S. Chirikjian,et al.  Modular Self-Reconfigurable Robot Systems [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[53]  Gerd Hirzinger,et al.  DLR hand II: hard- and software architecture for information processing , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[54]  Stig Moberg,et al.  Robust Control Of A Flexible Manipulator Arm : A Benchmark Problem , 2005 .

[55]  Peter K. Allen,et al.  Grasp Planning via Decomposition Trees , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[56]  Satoshi Murata,et al.  Self-reconfigurable robots , 2007, IEEE Robotics & Automation Magazine.

[57]  William Leithead,et al.  Semi-autonomous control of offshore cranes , 2007 .

[58]  Domenico Prattichizzo,et al.  Task priority grasping and locomotion control of modular robot , 2009, 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[59]  F. Sanfilippo,et al.  Efficient modular grasping: An iterative approach , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[60]  Stefan Ulbrich,et al.  The OpenGRASP benchmarking suite: An environment for the comparative analysis of grasping and dexterous manipulation , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[61]  Stefano Caselli,et al.  Grasp Programming by Demonstration: A task-based quality measure , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.

[62]  Chen Jinbiao Navigation simulator with 360° cylindrical stereo visual system , 2008 .

[63]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[64]  M. Taylan Das,et al.  Robotic applications with Particle Swarm Optimization (PSO) , 2013, 2013 International Conference on Control, Decision and Information Technologies (CoDIT).

[65]  Eduardo Boemo,et al.  Locomotion of a modular worm-like robot using a FPGA-based embedded microBlaze soft-processor , 2005 .

[66]  Luca Iocchi,et al.  A unified benchmark framework for autonomous Mobile robots and Vehicles Motion Algorithms (MoVeMA benchmarks) , 2008 .

[67]  Xiaodong Zhang,et al.  Design of wearable intelligent mind controlled prosthetic hand , 2012, 2012 IEEE International Conference on Mechatronics and Automation.

[68]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[69]  Edward A. Lee Cyber Physical Systems: Design Challenges , 2008, 2008 11th IEEE International Symposium on Object and Component-Oriented Real-Time Distributed Computing (ISORC).

[70]  Keoni Mahelona,et al.  DARPA Grand Challenge , 2007 .

[71]  G. Schreiber,et al.  The Fast Research Interface for the KUKA Lightweight Robot , 2022 .

[72]  Jun Wang,et al.  RECURRENT NEURAL NETWORKS FOR REAL-TIME COMPUTATION OF INVERSE KINEMATICS OF REDUNDANT MANIPULATORS , 2004 .

[73]  Kristin Ytterstad Pettersen,et al.  A wave simulator and active heave compensation framework for demanding offshore crane operations , 2015, 2015 IEEE 28th Canadian Conference on Electrical and Computer Engineering (CCECE).

[74]  F. Sanfilippo,et al.  A mapping approach for controlling different maritime cranes and robots using ANN , 2014, 2014 IEEE International Conference on Mechatronics and Automation.

[75]  Peter Sanders,et al.  Engineering Route Planning Algorithms , 2009, Algorithmics of Large and Complex Networks.

[76]  Andreas Junghanns,et al.  The Functional Mockup Interface for Tool independent Exchange of Simulation Models , 2011 .

[77]  J. Neupert,et al.  A heave compensation approach for offshore cranes , 2008, 2008 American Control Conference.

[78]  Richard Vaughan,et al.  Massively multi-robot simulation in stage , 2008, Swarm Intelligence.

[79]  William W. Melek,et al.  A Genetic Algorithm Approach to solve for Multiple Solutions of Inverse Kinematics using Adaptive Niching and Clustering , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[80]  Yoonju Cho,et al.  Brain-Computer Interface for a Prosthetic Hand Using Local Machine Control and Haptic Feedback , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[81]  Constantinos Mavroidis,et al.  FABRICATION OF A ROBOTIC HAND USING RAPID PROTOTYPING , 2000 .

[82]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[83]  Philippe Bidaud,et al.  Genetic design of 3D modular manipulators , 1997, Proceedings of International Conference on Robotics and Automation.

[84]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[85]  Jia Ni,et al.  The simulation research on passive heave compensation system for deep sea mining , 2009, 2009 International Conference on Mechatronics and Automation.

[86]  Murray Shanahan,et al.  Training a spiking neural network to control a 4-DoF robotic arm based on Spike Timing-Dependent Plasticity , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[87]  Michael R. Lyu,et al.  Handbook of software reliability engineering , 1996 .

[88]  A. Hellrand,et al.  Crane Control System With Active Heave Compensation and Constant Tension Modes Onboard the Vessel Stena Wel/servicer , 1990 .

[89]  J. Denavit,et al.  A kinematic notation for lower pair mechanisms based on matrices , 1955 .

[90]  Tad Hogg,et al.  Emergent structures in modular self-reconfigurable robots , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[91]  David Goldberg,et al.  Comparison of Heave Motion Compensation Systems on Scientific Ocean Drilling Ship and Their Effects on Wireline Logging Data , 2006 .