Adaptive motion planning for autonomous mass excavation

Autonomous excavation has attracted interest because of the potential for increased productivity and lower labor costs. This research concerns automating a hydraulic excavator for the task of mass excavation, where tons of earth are, excavated and loaded into trucks. Fast operational speed of these machines is desired because it directly translates to higher productivity. This research focuses on the motion planning aspect of the mass excavation task, with the goal equalling the performance of a highly skilled human operator. There are several problem characteristics that led to the motion planning approach. The excavator's motions are highly repetitive and deliberate, almost to the point of being scripted. However, the precise dig, dump, and truck locations do change between passes. The hydraulic actuation system of the excavator is highly non-linear, making it difficult to model. The operation proceeds quickly, with many buckets being loaded in a short amount of time. We have developed a motion planning approach known as parameterized scripting. A script describes a task as a series of simple steps. The parameters of the script define both the specific goals for each script step, and the transitions between steps. Script parameter values are computed based on the current task conditions. The parameter values affect both the operational speed and the accuracy in achieving desired task goals. The script parameter values are computed using information about the excavator's own performance, which is gathered on-line during task execution. The excavator's performance is evaluated and stored in a data base. Memory-based learning techniques are used to find the best set of parameter values for the given task conditions. The motion planning system has resulted in autonomous performance that approaches a skilled operator in the short term and outperforms him in the long term. The autonomous excavator's motions are also more accurate and consistent than a human's. The motion planning approach provides a highly flexible system. Because the motion planner uses data gathered on-line, it can be used on any excavator in any worksite conditions. The excavator can modify its behavior to achieve maximum productivity in its current working environment.

[1]  Maja J. Mataric,et al.  Reward Functions for Accelerated Learning , 1994, ICML.

[2]  Murali Krishna,et al.  Constructing Hydraulic Robot Models Using Memory-Based Learning , 1999 .

[3]  Sanjiv Singh,et al.  A Robotic Excavator for Autonomous Truck Loading , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[4]  Antti J. Koivo,et al.  Neural adaptive control of excavators , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[5]  Ian Sommerville,et al.  LUCIE the robot excavator-design for system safety , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[6]  Tomoaki Sakai,et al.  The 5th International Symposium on Robotics in Construction June 6-8,1988 Tokyo, Japan OPERATION SYSTEM FOR HYDRAULIC EXCAVATOR FOR DEEP TRENCH WORKS , 2011 .

[7]  Sanjiv Singh,et al.  Multi-resolution planning for earthmoving , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[8]  Peter D. Lawrence,et al.  Impedance control of a teleoperated mini excavator , 1997, 1997 8th International Conference on Advanced Robotics. Proceedings. ICAR'97.

[9]  Sridhar Mahadevan,et al.  Automatic Programming of Behavior-Based Robots Using Reinforcement Learning , 1991, Artif. Intell..

[10]  Ashwin Ram,et al.  Experiments with Reinforcement Learning in Problems with Continuous State and Action Spaces , 1997, Adapt. Behav..

[11]  S. Schaal,et al.  Robot juggling: implementation of memory-based learning , 1994, IEEE Control Systems.

[12]  Jeff G. Schneider High Dimension Action Spaces in Robot Skill Learning , 1994, AAAI.

[13]  Christopher G. Atkeson,et al.  Using locally weighted regression for robot learning , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[14]  William H. Press,et al.  Numerical Recipes in FORTRAN - The Art of Scientific Computing, 2nd Edition , 1987 .

[15]  Derek W. Seward,et al.  Controlling an intelligent excavator for autonomous digging in difficult ground. , 1992 .

[16]  Darcy M. Bullock,et al.  Force and Geometry Constraints in Robot Excavation , 1990 .

[17]  Anthony Stentz,et al.  Obstacle detection and safeguarding for a high-speed autonomous hydraulic excavator , 1999, Other Conferences.

[18]  Jeff Schneider,et al.  Robot Skill Learning Through Intelligent Experimentation , 1995 .

[19]  Christopher G. Atkeson,et al.  Task-level robot learning: juggling a tennis ball more accurately , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[20]  D. Sofge THE ROLE OF EXPLORATION IN LEARNING CONTROL , 1992 .

[21]  Fei-Yue Wang,et al.  A fuzzy control system for an automated mining excavator , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[22]  M. Kositsky A Cluster Memory Model for Learning Sequential Activities , 1998 .

[23]  Christopher G. Atkeson,et al.  Memory-Based Learning Control , 1991, 1991 American Control Conference.

[24]  Fei-Yue Wang,et al.  Task and behavior formulations for robotic rock excavation , 1995, Proceedings of Tenth International Symposium on Intelligent Control.

[25]  Francis L. Merat,et al.  Introduction to robotics: Mechanics and control , 1987, IEEE J. Robotics Autom..

[26]  Fei-Yue Wang,et al.  Experimental robotic excavation with fuzzy logic and neural networks , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[27]  Paul J. A. Lever,et al.  Intelligent Excavator Control System for Lunar Mining System , 1995 .

[28]  Sanjiv Singh,et al.  Learning to predict resistive forces during robotic excavation , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[29]  Ming Zhu,et al.  Coordinated and Force-Feedback Control of Hydraulic Excavators , 1995, ISER.

[30]  Septimiu E. Salcudean,et al.  Application of force feedback to heavy duty hydraulic machines , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[31]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[32]  Sanjiv Singh The State of the Art in Automation of Earthmoving , 1997 .

[33]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[34]  Anthony Stentz,et al.  Parameterized scripts for motion planning , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[35]  David J. Reinkensmeyer,et al.  Task-level robot learning , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[36]  Lonnie J. Dunlap Devier,et al.  Automatic excavation or excavator teaching control system and method , 1995 .