Learning and Reacting with Inaccurate Prediction: Applications to Autonomous Excavation

Motivated by autonomous excavation, this work investigates solutions to a class of problem where disturbance prediction is critical to overcoming poor performance of a feedback controller, but where the disturbance prediction is intrinsically inaccurate. Poor feedback controller performance is related to a fundamental control problem: due to causality there is only a limited amount of disturbance rejection that feedback compensation can provide. It is known, however, that the use of predictive compensation can improve the disturbance rejection of a control system beyond the limitations of feedback. While prediction is desirable in a controller, the problem in excavation is that disturbance predictions are prone to error due to the variability and complexity of soil-tool interaction forces. This work proposes the use of iterative learning control to map the repetitive components of excavation forces into feedforward predictive compensation commands. Although experimental results show that preemptive disturbance compensation improves excavation performance, the non-repetitive nature of soil-tool interaction forces when digging is a source of inaccurate predictions. To explicitly address the use of imperfect predictive compensation, a disturbance observer is used to estimate the prediction error rather than the disturbance. To quantify inaccuracy in prediction, a feedforward model of excavation disturbances is interpreted as a communication channel that transmits corrupted disturbance previews, for which metrics based on the sensitivity function exist. During field trials the proposed method demonstrated the ability to iteratively achieve a desired dig geometry, independent of the initial feasibility of the excavation passes in relation to hydraulic actuator flow saturation. Under this iterative method predictive commands adapted to different soil conditions and passes were repeated autonomously until a pre-specified finish quality of the trench was achieved. Evidence of improvement in disturbance rejection is presented as a comparison of sensitivity functions of systems with and without the use of disturbance compensation given by feedforward action, also referred to as disturbance previews.

[1]  Derek W. Seward,et al.  The Development, Control and Operation of an Autonomous Robotic Excavator , 1998, J. Intell. Robotic Syst..

[2]  Howard N. Cannon,et al.  Extended Earthmoving with an Autonomous Excavator , 1999 .

[3]  Joshua A. Marshall,et al.  Towards Autonomous Excavation of Fragmented Rock: Experiments, Modelling, Identification and Control , 2001 .

[4]  Kiyotsugu Takaba A tutorial on preview control systems , 2003, SICE 2003 Annual Conference (IEEE Cat. No.03TH8734).

[5]  Tore Hägglund,et al.  The future of PID control , 2000 .

[6]  Raffaello D'Andrea,et al.  A simple learning strategy for high-speed quadrocopter multi-flips , 2010, 2010 IEEE International Conference on Robotics and Automation.

[7]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[8]  L. W. Tsai,et al.  Robot Analysis: The Mechanics of Serial and Parallel Ma-nipulators , 1999 .

[9]  Peter D. Lawrence,et al.  Impedance control of a teleoperated mini excavator , 1997, 1997 8th International Conference on Advanced Robotics. Proceedings. ICAR'97.

[10]  D. Luenberger An introduction to observers , 1971 .

[11]  J. Slotine,et al.  On Sliding Observers for Nonlinear Systems , 1986, 1986 American Control Conference.

[12]  Raffaello D'Andrea,et al.  Optimization-based iterative learning for precise quadrocopter trajectory tracking , 2012, Autonomous Robots.

[13]  Ian R. Manchester,et al.  Identification and Control of a Hydraulic Forestry Crane , 2008 .

[14]  Charles E. Hall,et al.  Authors' reply to comments on "variable-structure PID control to prevent integrator windup" , 2001, IEEE Transactions on Industrial Electronics.

[15]  J. Maciejewski,et al.  Laboratory optimization of the soil digging process , 2002 .

[16]  Zhongsheng Hou,et al.  Adaptive ILC for a class of discrete-time systems with iteration-varying trajectory and random initial condition , 2008, Autom..

[17]  Keith Glover,et al.  A loop-shaping design procedure using H/sub infinity / synthesis , 1992 .

[18]  Diego Viejo,et al.  3D geological modelling using laser and hyperspectral data , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[19]  K. Moore,et al.  Harnessing the nonrepetitiveness in iterative learning control , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[20]  Hugh F. Durrant-Whyte,et al.  Variable structure systems approach to friction estimation and compensation , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[21]  Hugh F. Durrant-Whyte,et al.  Estimation of track-soil interactions for autonomous tracked vehicles , 1997, Proceedings of International Conference on Robotics and Automation.

[22]  R. Yousefi Moghaddam,et al.  Method and apparatus for on-line estimation of soil parameters during excavation , 2012 .

[23]  Rob H. Bracewell,et al.  Control and Operational Strategies for Automatic Excavation , 1989 .

[24]  Bernard Friedland,et al.  On adaptive friction compensation , 1991, [1991] Proceedings of the 30th IEEE Conference on Decision and Control.

[25]  Septimiu E. Salcudean,et al.  Nonlinear control of hydraulic robots , 2001, IEEE Trans. Robotics Autom..

[26]  M. Tomizuka,et al.  Precision Positioning of Wafer Scanners Segmented Iterative Learning Control for Nonrepetitive Disturbances [Applications of Control] , 2007, IEEE Control Systems.

[27]  Richard W. Longman,et al.  A mathematical theory of learning control for linear discrete multivariable systems , 1988 .

[28]  Richard W. Longman,et al.  Iterative learning control and repetitive control for engineering practice , 2000 .

[29]  Leonid Fridman,et al.  High‐order sliding‐mode observer for a quadrotor UAV , 2008 .

[30]  Septimiu E. Salcudean,et al.  Impedance control of a teleoperated excavator , 2002, IEEE Trans. Control. Syst. Technol..

[31]  Hisashi Osumi,et al.  Trajectory arrangement based on resistance force and shape of pile at scooping motion , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[32]  Darcy M. Bullock,et al.  A Laboratory Study of Force-Cognitive Excavation , 1989 .

[33]  Hugh F. Durrant-Whyte,et al.  Robotic excavation in construction automation , 2002, IEEE Robotics Autom. Mag..

[34]  Edwin Kreuzer,et al.  Sliding Mode Control with Adaptive Fuzzy Dead-Zone Compensation of an Electro-hydraulic Servo-System , 2010, J. Intell. Robotic Syst..

[35]  Septimiu E. Salcudean,et al.  Application of force feedback to heavy duty hydraulic machines , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[36]  Okko H. Bosgra,et al.  Synthesis of robust multivariable iterative learning controllers with application to a wafer stage motion system , 2000 .

[37]  Chris Hendrickson,et al.  A Strategic Planner for Robot Excavation , 1989 .

[38]  H. W. Bode,et al.  Network analysis and feedback amplifier design , 1945 .

[39]  Mikael Norrlöf,et al.  DISTURBANCE REJECTION USING AN ILC ALGORITHM WITH ITERATION VARYING FILTERS , 2004 .

[40]  Tore Hägglund,et al.  Automatic Tuning and Adaptation for PID Controllers - A Survey , 1992 .

[41]  Fei-Yue Wang,et al.  Experimental robotic excavation with fuzzy logic and neural networks , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[42]  U. Shaked,et al.  Linear discrete-time H∞-optimal tracking with preview , 1997, IEEE Trans. Autom. Control..

[43]  Fei-Yue Wang,et al.  Agent-based control for fuzzy behavior programming in robotic excavation , 2004, IEEE Transactions on Fuzzy Systems.

[44]  Anthony Stentz,et al.  Parameterized scripts for motion planning , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[45]  H.F. Durrant-Whyte,et al.  Force/position tracking for electrohydraulic systems of a robotic excavator , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[46]  Kevin L. Moore,et al.  Iterative Learning Control: Brief Survey and Categorization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[47]  Weiping Li,et al.  Applied Nonlinear Control , 1991 .

[48]  Munther A. Dahleh,et al.  Fundamental Limitations of Disturbance Attenuation in the Presence of Side Information , 2005, CDC 2005.

[49]  Karsten Berns,et al.  Simulation and control of an autonomous bucket excavator for landscaping tasks , 2010, 2010 IEEE International Conference on Robotics and Automation.

[50]  Fiorenzo Malaguti,et al.  Soil Machine Interaction in Digging and Earthmoving Automation , 1994 .

[51]  P. Iglesias An analogue of Bode's integral for stable nonlinear systems: relations to entropy , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[52]  Joshua A. Marshall,et al.  Toward Autonomous Excavation of Fragmented Rock: Full-Scale Experiments , 2008, IEEE Transactions on Automation Science and Engineering.

[53]  S. Arimoto,et al.  Equivalence relations between learnability, output-dissipativity and strict positive realness , 2000 .

[54]  Paul J. A. Lever,et al.  An automated digging control for a wheel loader , 2001, Robotica.

[55]  YangQuan Chen,et al.  Iterative Learning Control: A Tutorial and Big Picture View , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[56]  Rui Liu,et al.  A simplified approach to force control for electro-hydraulic systems☆ , 2000 .

[57]  Karsten Berns,et al.  An autonomous excavator for landscaping tasks , 2010, ISR/ROBOTIK.

[58]  Peter Seiler,et al.  Performance limits with preview information and actuator rate constraints , 2012, 2012 American Control Conference (ACC).

[59]  Svante Gunnarsson,et al.  Disturbance aspects of iterative learning control , 2001 .

[60]  Jian-Xin Xu,et al.  Freeway Traffic Control Using Iterative Learning Control-Based Ramp Metering and Speed Signaling , 2007, IEEE Transactions on Vehicular Technology.

[61]  A.G. Alleyne,et al.  A survey of iterative learning control , 2006, IEEE Control Systems.

[62]  Kevin L. Moore,et al.  Iterative Learning Control: An Expository Overview , 1999 .

[63]  Sanjiv Singh,et al.  A Robotic Excavator for Autonomous Truck Loading , 1999, Auton. Robots.

[64]  Matt Adcock,et al.  The Development of a Telerobotic Rock Breaker , 2009, FSR.

[65]  Lake Hugh Muntz OPERATION AND MAINTENANCE MANUAL , 2008 .

[66]  Graham C. Goodwin,et al.  Fundamental Limitations in Filtering and Control , 1997 .

[67]  Carl J. Kempf,et al.  Disturbance observer and feedforward design for a high-speed direct-drive positioning table , 1999, IEEE Trans. Control. Syst. Technol..

[68]  Suguru Arimoto,et al.  Bettering operation of Robots by learning , 1984, J. Field Robotics.

[69]  Jie Chen,et al.  Tracking sensitivity and achievable I performance in preview control , 2004, Autom..

[70]  Akira Kojima,et al.  H∞ performance of preview control systems , 2003, Autom..

[71]  Antti J. Koivo,et al.  Neural adaptive control of excavators , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[72]  Eyal Dassau,et al.  Closed-Loop Control of Artificial Pancreatic $\beta$ -Cell in Type 1 Diabetes Mellitus Using Model Predictive Iterative Learning Control , 2010, IEEE Transactions on Biomedical Engineering.

[73]  Michael J. Grimble,et al.  Iterative Learning Control for Deterministic Systems , 1992 .

[74]  Hui Shao,et al.  Automatic Excavation Planning of Hydraulic Excavator , 2008, ICIRA.

[75]  M. Phan,et al.  Higher-order iterative learning control by pole placement and noise filtering , 2002 .

[76]  Hiroshi Yamamoto,et al.  Motion Analysis of Hydraulic Excavator in Excavating and Loading Work for Autonomous Control , 2006 .

[77]  Miroslaw J. Skibniewski,et al.  Dynamic Model of Excavator , 1993 .

[78]  H. Asama,et al.  The analysis of excavator operation by skillful operator - extraction of common skills - , 2008, 2008 SICE Annual Conference.

[79]  James E. Bobrow,et al.  Experiments and simulations on the nonlinear control of a hydraulic servosystem , 1997, Proceedings of the 1997 American Control Conference (Cat. No.97CH36041).

[80]  A. Rantzer,et al.  System analysis via integral quadratic constraints , 1997, IEEE Trans. Autom. Control..

[81]  Noriho Koyachi,et al.  Field test of autonomous loading operation by wheel loader , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[82]  K.J. Astrom,et al.  Revisiting the LuGre friction model , 2008, IEEE Control Systems.

[83]  Peter I. Corke,et al.  Variable structure methods in hydraulic servo systems control , 2001, Autom..

[84]  Leonhard E. Bernold,et al.  Motion and Path Control for Robotic Excavation , 1993 .

[85]  Jongwon Seo,et al.  Task planner design for an automated excavation system , 2011 .

[86]  Sanjiv Singh,et al.  Modeling and identification of soil-tool interaction in automated excavation , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[87]  J. G. Ziegler,et al.  Optimum Settings for Automatic Controllers , 1942, Journal of Fluids Engineering.

[88]  Y.H. Zweiri,et al.  Online soil parameter estimation scheme based on Newton-Raphson method for autonomous excavation , 2005, IEEE/ASME Transactions on Mechatronics.

[89]  Kenji Fujimoto,et al.  Gait Generation for Passive Running via Iterative Learning Control , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[90]  E. McKyes,et al.  Prediction and field measurements of tillage tool draft forces and efficiency in cohesive soils , 1984 .

[91]  John G. Proakis,et al.  Probability, random variables and stochastic processes , 1985, IEEE Trans. Acoust. Speech Signal Process..

[92]  R. Merry,et al.  Removing non-repetitive disturbances in iterative learning control by wavelet filtering , 2006, 2006 American Control Conference.

[93]  Mark Whitty,et al.  Robotics, Vision and Control. Fundamental Algorithms in MATLAB , 2012 .

[94]  アール ゲイ ジョン Method for developing algorithm for efficiently controlling autonomous excavating linkage , 2001 .

[95]  Svante Gunnarsson,et al.  On the design of ILC algorithms using optimization , 2001, Autom..

[96]  Jian-Shiang Chen,et al.  A WAVELET-BASED ITERATIVE LEARNING CONTROL SCHEME FOR MOTION CONTROL SYSTEMS , 2005 .

[97]  Hugh F. Durrant-Whyte,et al.  Fuzzy moving sliding mode control with application to robotic manipulators , 1999, Autom..

[98]  Ferri P. Hassani,et al.  An Overview of Autonomous Loading of Bulk Material , 2009 .

[99]  Michael G. Lipsett,et al.  Review of Resistive Force Models for Earthmoving Processes , 2001 .

[100]  Kazuo Fujishima,et al.  Digging control system for hydraulic excavator , 2001 .

[101]  Anders Robertsson,et al.  Force controlled robotic assembly without a force sensor , 2012, 2012 IEEE International Conference on Robotics and Automation.

[102]  Antti J. Koivo Kinematics of Excavators (Backhoes) for Transferring Surface Material , 1994 .

[103]  R. Kelly,et al.  PD control with computed feedforward of robot manipulators: a design procedure , 1994, IEEE Trans. Robotics Autom..

[104]  Alessandro De Luca,et al.  Friction observer and compensation for control of robots with joint torque measurement , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[105]  Sanjiv Singh,et al.  Models for Automated Earthmoving , 1999, ISER.

[106]  Clarence W. de Silva,et al.  Tracking control of an electrohydraulic manipulator in the presence of friction , 1998, IEEE Trans. Control. Syst. Technol..

[107]  Carlos Canudas-de-Wit,et al.  Friction compensation for an industrial hydraulic robot , 1999 .

[108]  Peter I. Corke,et al.  Autonomous excavation using a rope shovel , 2006, FSR.

[109]  Fanping Bu,et al.  Nonlinear adaptive robust control of hydraulic actuators regulated by proportional directional control valves with deadband and nonlinear flow gains , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[110]  Hugh Durrant-Whyte,et al.  Impedance control of a hydraulically actuated robotic excavator , 2000 .

[111]  Surya P. N. Singh,et al.  Improving operational space control of heavy manipulators via open-loop compensation , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[112]  Bruce A. Francis,et al.  The internal model principle of control theory , 1976, Autom..

[113]  Akira Kojima,et al.  LQ preview synthesis: optimal control and worst case analysis , 1999, IEEE Trans. Autom. Control..

[114]  M. Tomizuka Optimal continuous finite preview problem , 1975 .

[115]  A. Jarzebowski,et al.  The Optimisation of Tool Shapes and Trajectories in Heavy Machines , 1995 .

[116]  Munther A. Dahleh,et al.  Feedback Control in the Presence of Noisy Channels: “Bode-Like” Fundamental Limitations of Performance , 2008, IEEE Transactions on Automatic Control.

[117]  Fiorenzo Malaguti Cutting and Impedance Model of Soil-Excavator Interaction , 2005 .

[118]  N. Sepehri,et al.  Adaptive backstepping control of hydraulic manipulators with friction compensation using LuGre model , 2006, 2006 American Control Conference.

[119]  Jean-Pierre Barbot,et al.  Sliding Mode Control In Engineering , 2002 .

[120]  Si-Zhao Joe Qin,et al.  A two-stage iterative learning control technique combined with real-time feedback for independent disturbance rejection , 2004, Autom..

[121]  W. Richardson-Little,et al.  Position accommodation and compliance control for robotic excavation , 2005, Proceedings of 2005 IEEE Conference on Control Applications, 2005. CCA 2005..

[122]  Yuichi Matsumoto,et al.  Modeling of force sensing and validation of disturbance observer for force control , 2003, IECON'03. 29th Annual Conference of the IEEE Industrial Electronics Society (IEEE Cat. No.03CH37468).

[123]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[124]  Pieter Abbeel,et al.  Superhuman performance of surgical tasks by robots using iterative learning from human-guided demonstrations , 2010, 2010 IEEE International Conference on Robotics and Automation.

[125]  Fiorenzo Malaguti Variable Structure Control in Excavator Robot , 1994 .

[126]  Roger Dixon,et al.  COMPARISON OF CLASSICAL AND MODERN CONTROL APPLIED TO AN EXCAVATOR-ARM , 2005 .

[127]  Suguru Arimoto,et al.  Iterative learning scheme for a redundant manipulator: Skilled hand writing motion on an arbitrary smooth surface , 2011, 2011 IEEE International Conference on Robotics and Automation.

[128]  Jan Szlagowski,et al.  Automated Excavation Process Analysis for Given Trajectory and Soil Parameters , 2008 .

[129]  Peng Hao,et al.  Modeling and controlling for hydraulic excavator's arm , 2005 .

[130]  Peter I. Corke,et al.  A pressure-based, velocity independent, friction model for asymmetric hydraulic cylinders , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[131]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation , 1984, 1984 American Control Conference.

[132]  Kaspar Althoefer,et al.  Hybrid Soil Parameter Measurement and Estimation Scheme for Excavation Automation , 2009, IEEE Transactions on Instrumentation and Measurement.

[133]  Fiorenzo Malaguti Improved Model of Soil for Environment-Robot Excavator Interaction , 1999 .

[134]  Ian R. Manchester,et al.  Virtual environment teleoperation of a hydraulic forestry crane , 2008, 2008 IEEE International Conference on Robotics and Automation.

[135]  Pyung Hun Chang,et al.  Control of a heavy-duty robotic excavator using time delay control with integral sliding surface , 2002 .

[136]  Sanjiv Singh,et al.  Learning to predict resistive forces during robotic excavation , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[137]  Bokman Lim,et al.  Bandwidth Maximizing Design for Hydraulically Actuated Excavators , 2010 .

[138]  A. R. Reece Paper 2: The Fundamental Equation of Earth-Moving Mechanics , 1964 .

[139]  Nguyen Hong Quang,et al.  Robust low level control of robotic excavation , 2000 .

[140]  Miroslaw J. Skibniewski,et al.  Cognitive Force Control of Excavators , 1993 .

[141]  Jongwon Kim,et al.  Excavator tele-operation system using a human arm , 2009 .

[142]  Juan Andrade-Cetto,et al.  Modeling and Control of Excavator Dynamics during Digging Operation , 1996 .

[143]  Brett Kennedy,et al.  System of systems for space construction , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.