Haptic Control of Mobile Manipulators Interacting with the Environment

In the modern society the haptic control of robotic manipulators plays a central role in many industrial fields because of the improvement of human capabilities and the prevention of many hazards that it can provide. Many different studies are focusing on the improvement of the operator experience, aiming at simplifying the control interface and increasing the level of intuitiveness that the system can provide to a non-trained user. This work focus on the control of mobile manipulator platforms, that are gaining popularity in the industrial world because of their capability to merge the manipulation of the environment with a potentially infinite workspace. In particular three different aspects concerning the haptic shared control of mobile manipulators will be studied. Initially the manipulation of liquid container is analyzed and a new feed-forward filtering technique able to guarantee a slosh free motion without any a priori knowledge of the imposed trajectory is proposed. Then the trajectory planning for a mobile base in an unstructured environment is considered. A new planner based on the properties of B-spline curves is studied and tested for both the haptic and the autonomous case. Eventually the control of a mobile manipulator by means of a single commercial haptic device is addressed. A new mapping technique able to provide an intuitive interface for the control for the human operator is presented. The effectiveness of the proposed works is confirmed viaseveral experimental tests.

[1]  T. Murakami,et al.  An approach to expansion of workspace motion in master-slave control system , 2012, IECON 2012 - 38th Annual Conference on IEEE Industrial Electronics Society.

[2]  Jean-Claude Latombe,et al.  Robot Motion Planning: A Distributed Representation Approach , 1991, Int. J. Robotics Res..

[3]  Thomas B. Sheridan,et al.  Space teleoperation through time delay: review and prognosis , 1993, IEEE Trans. Robotics Autom..

[4]  Davide Chiaravalli,et al.  A Plug-In Feed-Forward Control for Sloshing Suppression in Robotic Teleoperation Tasks , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[5]  Siddhartha S. Srinivasa,et al.  A policy-blending formalism for shared control , 2013, Int. J. Robotics Res..

[6]  Claudio Melchiorri,et al.  Teleoperation of a mobile robot through haptic feedback , 2002, IEEE International Workshop HAVE Haptic Virtual Environments and Their.

[7]  Mark Mulder,et al.  The effect of haptic guidance on curve negotiation behavior of young, experienced drivers , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[8]  David A. Abbink,et al.  Neuromuscular analysis of haptic gas pedal feedback during car following , 2006 .

[9]  Thomas B. Sheridan,et al.  A model-based predictive operator aid for telemanipulators with time delay , 1989, Conference Proceedings., IEEE International Conference on Systems, Man and Cybernetics.

[10]  Cristian Secchi,et al.  Optimizing the use of power in wave based bilateral teleoperation , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  Pål Johan From,et al.  Control allocation for mobile manipulators with on-board cameras , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  K. Terashima,et al.  Sloshing suppression control of liquid transfer systems considering a 3-D transfer path , 2005, IEEE/ASME Transactions on Mechatronics.

[13]  Jee-Hwan Ryu,et al.  Hybrid position-position and position-speed command strategy for the bilateral teleoperation of a mobile robot , 2007, 2007 International Conference on Control, Automation and Systems.

[14]  O. Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[15]  Claudio Melchiorri,et al.  B-spline based filters for multi-point trajectories planning , 2010, 2010 IEEE International Conference on Robotics and Automation.

[16]  Heinz Wörn,et al.  Using Acceleration Compensation to Reduce Liquid Surface Oscillation During a High Speed Transfer , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[17]  Nadeem Javaid,et al.  IBA: Intelligent Bug Algorithm – A Novel Strategy to Navigate Mobile Robots Autonomously , 2013 .

[18]  J. Schwartz,et al.  On the “piano movers” problem. II. General techniques for computing topological properties of real algebraic manifolds , 1983 .

[19]  Blake Hannaford,et al.  A detailed model of bi-lateral teleoperation , 1988, Proceedings of the 1988 IEEE International Conference on Systems, Man, and Cybernetics.

[20]  Ken'ichi Yano,et al.  Robust liquid container transfer control for complete sloshing suppression , 2001, IEEE Trans. Control. Syst. Technol..

[21]  Abhishek Gupta,et al.  Shared Control in Haptic Systems for Performance Enhancement and Training , 2006 .

[22]  René van Paassen,et al.  Artificial Force Field for Haptic Feedback in UAV Teleoperation , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[23]  Mark Mulder,et al.  Neuromuscular Analysis as a Guideline in designing Shared Control , 2010 .

[24]  Cristian Secchi,et al.  Catching the wave: A transparency oriented wave based teleoperation architecture , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[25]  D.K. Liu,et al.  Workspace mapping and force control for small haptic device based robot teleoperation , 2009, 2009 International Conference on Information and Automation.

[26]  Marc G. Slack Navigation templates: mediating qualitative guidance and quantitative control in mobile robots , 1993, IEEE Trans. Syst. Man Cybern..

[27]  Christopher D. Wickens,et al.  Humans: Still Vital After All These Years of Automation , 2008, Hum. Factors.

[28]  Siddhartha S. Srinivasa,et al.  Shared autonomy via hindsight optimization for teleoperation and teaming , 2017, Int. J. Robotics Res..

[29]  B. Faverjon,et al.  Probabilistic Roadmaps for Path Planning in High-Dimensional Con(cid:12)guration Spaces , 1996 .

[30]  Mark W. Spong,et al.  Bilateral teleoperation: An historical survey , 2006, Autom..

[31]  Jee-Hwan Ryu,et al.  Shared Teleoperation for Nuclear Plant Robotics Using Interactive Virtual Guidance Generation and Shared Autonomy Approaches , 2018, 2018 15th International Conference on Ubiquitous Robots (UR).

[32]  Jean-Claude Latombe,et al.  Robot motion planning , 1970, The Kluwer international series in engineering and computer science.

[33]  Volkan Sezer,et al.  A novel obstacle avoidance algorithm: "Follow the Gap Method" , 2012, Robotics Auton. Syst..

[34]  Dale A. Lawrence Stability and transparency in bilateral teleoperation , 1993, IEEE Trans. Robotics Autom..

[35]  Víctor H. Andaluz,et al.  Switching control signal for bilateral tele-operation of a mobile manipulator , 2011, 2011 9th IEEE International Conference on Control and Automation (ICCA).

[36]  M. M. van Paassen,et al.  Design and Evaluation of a Haptic Flight Director , 2006 .

[37]  Claudio Melchiorri,et al.  Control of liquid handling robotic systems: A feed-forward approach to suppress sloshing , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[38]  Louis B. Rosenberg,et al.  Virtual fixtures: Perceptual tools for telerobotic manipulation , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[39]  Stefano Stramigioli,et al.  Bilateral Telemanipulation With Time Delays: A Two-Layer Approach Combining Passivity and Transparency , 2011, IEEE Transactions on Robotics.

[40]  Mark Mulder,et al.  Haptic shared control: smoothly shifting control authority? , 2012, Cognition, Technology & Work.

[41]  Blake Hannaford,et al.  Stability and performance tradeoffs in bi-lateral telemanipulation , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[42]  Raja Parasuraman,et al.  Designing for Flexible Interaction Between Humans and Automation: Delegation Interfaces for Supervisory Control , 2007, Hum. Factors.

[43]  Serdar Kucuk,et al.  Maximal dexterous trajectory generation and cubic spline optimization for fully planar parallel manipulators , 2016, Comput. Electr. Eng..

[44]  Dongjun Lee,et al.  Passive-Set-Position-Modulation Framework for Interactive Robotic Systems , 2010, IEEE Transactions on Robotics.

[45]  Mustafa Arafa,et al.  Design and optimization of input shapers for liquid slosh suppression , 2009 .

[46]  Allison M. Okamura,et al.  Speed-Accuracy Characteristics of Human-Machine Cooperative Manipulation Using Virtual Fixtures With Variable Admittance , 2004, Hum. Factors.

[47]  Karon E. MacLean,et al.  Predictive haptic guidance: intelligent user assistance for the control of dynamic tasks , 2006, IEEE Transactions on Visualization and Computer Graphics.

[48]  Blake Hannaford,et al.  A design framework for teleoperators with kinesthetic feedback , 1989, IEEE Trans. Robotics Autom..

[49]  Kazuhiko Terashima,et al.  Modeling and input shaping control of liquid vibration for an automatic pouring system , 1996, Proceedings of 35th IEEE Conference on Decision and Control.

[50]  Mohamed Fanni,et al.  Workspace mapping and control of a teleoperated endoscopic surgical robot , 2014, 2014 19th International Conference on Methods and Models in Automation and Robotics (MMAR).

[51]  Davide Chiaravalli,et al.  A hybrid teleoperation control scheme for a single-arm mobile manipulator with omnidirectional wheels , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[52]  Ahmed A. Ramadan,et al.  Development of a teleoperation system with a new workspace spanning technique , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[53]  Mark Mulder,et al.  Exploring the Dimensions of Haptic Feedback Support in Manual Control , 2009, J. Comput. Inf. Sci. Eng..

[54]  John Canny,et al.  The complexity of robot motion planning , 1988 .

[55]  Oussama Khatib,et al.  Spanning large workspaces using small haptic devices , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[56]  Riccardo Muradore,et al.  A Review of Bilateral Teleoperation Algorithms , 2016 .

[57]  Kazuhiko Terashima,et al.  Integrated Trajectory Planning and Sloshing Suppression for Three-Dimensional Motion of Liquid Container Transfer Robot Arm , 2015, J. Robotics.

[58]  G. Oriolo,et al.  Robotics: Modelling, Planning and Control , 2008 .

[59]  Ronald C. Arkin,et al.  Motor Schema — Based Mobile Robot Navigation , 1989, Int. J. Robotics Res..

[60]  R. Brent Gillespie,et al.  Sharing Control Between Humans and Automation Using Haptic Interface: Primary and Secondary Task Performance Benefits , 2005, Hum. Factors.

[61]  Blake Hannaford,et al.  Time domain passivity control of haptic interfaces , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[62]  Charles E. Billings,et al.  Aviation Automation: The Search for A Human-centered Approach , 1996 .

[63]  Chee-Keng Yap,et al.  A "Retraction" Method for Planning the Motion of a Disc , 1985, J. Algorithms.

[64]  Sanjiv Singh,et al.  An efficient on-line path planner for outdoor mobile robots , 2000, Robotics Auton. Syst..

[65]  Jie Huang,et al.  Slosh Suppression for Infinite Modes in a Moving Liquid Container , 2015, IEEE/ASME Transactions on Mechatronics.

[66]  Jean-Jacques E. Slotine,et al.  Stable Adaptive Teleoperation , 1990, 1990 American Control Conference.

[67]  Clark R. Dohrmann,et al.  Control for slosh-free motion of an open container , 1997 .

[68]  S Stefan Lichiardopol,et al.  A Survey on Teleoperation , 2007 .

[69]  Ken'ichi Yano,et al.  Sloshing analysis and suppression control of tilting-type automatic pouring machine , 2001 .

[70]  Kenneth H. Goodrich,et al.  Application of the H-Mode, A Design and Interaction Concept for Highly Automated Vehicles, to Aircraft , 2006, 2006 ieee/aiaa 25TH Digital Avionics Systems Conference.

[71]  Kun Bai,et al.  Shaping Container Motion for Multimode and Robust Slosh Suppression , 2013 .

[72]  Mark W. Spong,et al.  Bilateral control of teleoperators with time delay , 1989 .

[73]  Claudio Melchiorri,et al.  Trajectory Planning for Automatic Machines and Robots , 2010 .

[74]  Luca Consolini,et al.  Minimum-time feedforward control of an open liquid container , 2013, IECON 2013 - 39th Annual Conference of the IEEE Industrial Electronics Society.

[75]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[76]  Frans C. T. van der Helm,et al.  The Impact of Haptic Feedback Quality on the Performance of Teleoperated Assembly Tasks , 2013, IEEE Transactions on Haptics.

[77]  Chaomin Luo,et al.  Sensor-based autonomous robot navigation under unknown environments with grid map representation , 2014, 2014 IEEE Symposium on Swarm Intelligence.

[78]  Pete Trautman,et al.  Assistive Planning in Complex, Dynamic Environments: A Probabilistic Approach , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[79]  Frank Flemisch,et al.  Automation spectrum, inner / outer compatibility and other potentially useful human factors concepts for assistance and automation , 2008 .