Nonlinear Model Predictive Visual Path Following Control to Autonomous Mobile Robots

This paper proposes a novel approach to the visual path following problem based on Nonlinear Model Predictive Control. Simplified visual features are extracted from the path to be followed. Then, aiming to calculate the control actions directly from the image plane, a regulatory model is obtained in the optimal control problem scope. For this purpose a Serret-Frenet system is placed in the center of camera’s field of view and the optimal control actions generate velocity references to an inner loop embedded in the robot. Stability issues are handled through a classical method and a new approach based on constraints relaxation is proposed in order to guarantee feasibility. Experimental results with a nonholonomic platform illustrate the performance of the proposed control scheme.

[1]  Georges Bastin,et al.  Stability analysis of a vision-based control design for an autonomous mobile robot , 2006, IEEE Transactions on Robotics.

[2]  Stefano Soatto,et al.  Visual path following by recursive spline updating , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[3]  Eun Jung Park.  Exploring LEGO Mindstorms EV3: Tools and Techniques for Building and Programming Robots , 2014 .

[4]  Peter Spellucci,et al.  An SQP method for general nonlinear programs using only equality constrained subproblems , 1998, Math. Program..

[5]  Lorenz T. Biegler,et al.  Constraint handing and stability properties of model‐predictive control , 1994 .

[6]  Tingting Wang,et al.  Neural Network-Based Image Moments for Robotic Visual Servoing , 2015, J. Intell. Robotic Syst..

[7]  Giuseppe Oriolo,et al.  An image-based visual servoing scheme for following paths with nonholonomic mobile robots , 2008, 2008 10th International Conference on Control, Automation, Robotics and Vision.

[8]  D. Q. Mayne,et al.  Suboptimal model predictive control (feasibility implies stability) , 1999, IEEE Trans. Autom. Control..

[9]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[10]  Giuseppe Oriolo,et al.  A position-based visual servoing scheme for following paths with nonholonomic mobile robots , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Sinisa Segvic,et al.  Outdoor visual path following experiments , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Mohammed Al Masri,et al.  Autolanding a Power-off UAV Using On-line Optimization and Slip Maneuvers , 2017, J. Intell. Robotic Syst..

[13]  Rolf Findeisen,et al.  Nonlinear Model Predictive Control for Constrained Output Path Following , 2015, IEEE Transactions on Automatic Control.

[14]  Chun-Yi Su,et al.  Vision-Based Model Predictive Control for Steering of a Nonholonomic Mobile Robot , 2016, IEEE Transactions on Control Systems Technology.

[15]  Joanna Plaskonka,et al.  Different Kinematic Path Following Controllers for a Wheeled Mobile Robot of (2,0) Type , 2015, J. Intell. Robotic Syst..

[16]  Nabil Aouf,et al.  Vision Based Autonomous Landing of Multirotor UAV on Moving Platform , 2017, J. Intell. Robotic Syst..

[17]  Christoforos Kanellakis,et al.  Survey on Computer Vision for UAVs: Current Developments and Trends , 2017, Journal of Intelligent & Robotic Systems.

[18]  George K. I. Mann,et al.  An Optimization Based Approach for Relative Localization and Relative Tracking Control in Multi-Robot Systems , 2017, J. Intell. Robotic Syst..

[19]  Tomasz Rybus,et al.  Control System for Free-Floating Space Manipulator Based on Nonlinear Model Predictive Control (NMPC) , 2017, J. Intell. Robotic Syst..

[20]  Gera Weiss,et al.  Vision Based Output Feedback Control of Micro Aerial Vehicles in Indoor Environments , 2017, J. Intell. Robotic Syst..

[21]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[22]  Pengwen Xiong,et al.  Egocentric-Vision based Hand Posture Control System for Reconnaissance Robots , 2017, J. Intell. Robotic Syst..

[23]  Gustavo Arechavaleta,et al.  Visual path following using a sequence of target images and smooth robot velocities for humanoid navigation , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[24]  Massimo Bertozzi,et al.  Vision-based intelligent vehicles: State of the art and perspectives , 2000, Robotics Auton. Syst..

[25]  Fakhrul Alam,et al.  Gaussian Process Model Predictive Control of an Unmanned Quadrotor , 2016, Journal of Intelligent & Robotic Systems.

[26]  Suat Karakaya,et al.  Design and Implementation of a Multi Sensor Based Brain Computer Interface for a Robotic Wheelchair , 2017, J. Intell. Robotic Syst..

[27]  Danilo Alves de Lima,et al.  A Visual Servoing approach for road lane following with obstacle avoidance , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).