Vision‐based operations of a large industrial vehicle: Autonomous hot metal carrier

Hot metal carriers (HMCs) are large forklift-type vehicles used to move molten metal in aluminum smelters. This paper reports on field experiments that demonstrate that HMCs can operate autonomously and in particular can use vision as a primary sensor to locate the load of aluminum. We present our complete system but focus on the vision system elements and also detail experiments demonstrating reliable operation of the materials handling task. Two key experiments are described, lasting 2 and 5 h, in which the HMC traveled 15 km in total and handled the load 80 times.

[1]  M.C. Mora,et al.  Factory management and transport automation , 2003, EFTA 2003. 2003 IEEE Conference on Emerging Technologies and Factory Automation. Proceedings (Cat. No.03TH8696).

[2]  Michael Seelinger,et al.  Automatic visual guidance of a forklift engaging a pallet , 2006, Robotics Auton. Syst..

[3]  Michael Bosse,et al.  Calibrated, Registered Images of an Extended Urban Area , 2003, International Journal of Computer Vision.

[4]  Michael Bosse,et al.  Calibrated, Registered Images of an Extended Urban Area , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Peter Wall,et al.  Mobile robot navigation using self-similar landmarks , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[6]  Kazuhito Yokoi,et al.  A tele-operated humanoid robot drives a backhoe , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[7]  Michael J. Seelinger,et al.  Automatic Pallet Engagment by a Vision Guided Forklift , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[8]  Jonathan M. Roberts,et al.  Autonomous Hot Metal Carrier , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[9]  Peter I. Corke,et al.  Autonomous control of underground mining vehicles using reactive navigation , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[10]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[11]  Peter I. Corke,et al.  Reactive navigation and opportunistic localization for autonomous underground mining vehicles , 2002, Inf. Sci..

[12]  Andrew W. Fitzgibbon,et al.  Reliable Fiducial Detection in Natural Scenes , 2004, ECCV.

[13]  Juan D. Tardós,et al.  Data association in stochastic mapping using the joint compatibility test , 2001, IEEE Trans. Robotics Autom..

[14]  Giovanni Garibotto,et al.  ROBOLIFT: a vision guided autonomous fork-lift for pallet handling , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[15]  Jane Mulligan,et al.  Editorial for Journal of Field Robotics - Special Issue on Machine Learning Based Robotics in Unstructured Environments , 2006, J. Field Robotics.

[16]  Giovanni Garibotto,et al.  Service robotics in logistic automation: ROBOLIFT: vision based autonomous navigation of a conventional fork-lift for pallet handling , 1997, 1997 8th International Conference on Advanced Robotics. Proceedings. ICAR'97.

[17]  Åke Wernersson,et al.  Docking to pallets with feedback from a sheet-of-light range camera , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[18]  Martin Buehler,et al.  Summary of DGC 2005 results , 2006, J. Field Robotics.

[19]  Martin Buehler,et al.  Editorial for Journal of Field Robotics—Special Issue on the DARPA Grand Challenge , 2006, J. Field Robotics.

[20]  Amaury Nègre,et al.  Robust Vision-Based Underwater Target Identification and Homing Using Self-Similar Landmarks , 2007, FSR.

[21]  Graeme Nelmes,et al.  Container Port Automation , 2005, International Symposium on Field and Service Robotics.

[22]  Nassir Navab,et al.  Visual marker detection and decoding in AR systems: a comparative study , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[23]  François Chaumette,et al.  Path planning for robust image-based control , 2002, IEEE Trans. Robotics Autom..

[24]  Giovanni Garibotto,et al.  Industrial exploitation of computer vision in logistic automation: autonomous control of an intelligent forklift truck , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).