Autonomous pallet localization and picking for industrial forklifts: a robust range and look method

A combined double-sensor architecture, laser and camera, and a new algorithm named RLPF are presented as a solution to the problem of identifying and localizing a pallet, the position and angle of which are a priori known with large uncertainty. Solving this task for autonomous robot forklifts is of great value for logistics industry. The state-of-the-art is described to show how our approach overcomes the limitations of using either laser ranging or vision. An extensive experimental campaign and uncertainty analysis are presented. For the docking task, new dynamic nonlinear path planning which takes into account vehicle dynamics is proposed.

[1]  Hans B. Pacejka,et al.  Tire and Vehicle Dynamics , 1982 .

[2]  Åke Wernersson,et al.  Docking to pallets with feedback from a sheet-of-light range camera , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[3]  E. Bertolazzi,et al.  real-time motion planning for multibody systems , 2007 .

[4]  Emilio Frazzoli,et al.  Closed-loop Pallet Engagement in Unstructured Environments , 2010, IROS 2010.

[5]  Giovanni Garibotto,et al.  Service robotics in logistic automation: ROBOLIFT: vision based autonomous navigation of a conventional fork-lift for pallet handling , 1997, 1997 8th International Conference on Advanced Robotics. Proceedings. ICAR'97.

[6]  Margaret H. Wright,et al.  Direct search methods: Once scorned, now respectable , 1996 .

[7]  Hyojoo Son,et al.  Rapid 3D object detection and modeling using range data from 3D range imaging camera for heavy equipment operation , 2010 .

[8]  Roger V. Bostelman,et al.  Visualization of pallets , 2006, SPIE Optics East.

[9]  Robert C. Bolles,et al.  Parametric Correspondence and Chamfer Matching: Two New Techniques for Image Matching , 1977, IJCAI.

[10]  Rita Cucchiara,et al.  Focus based Feature Extraction for Pallets Recognition , 2000, BMVC.

[11]  Alonzo Kelly,et al.  Model based object pose refinement for terrestrial and space autonomy , 2000 .

[12]  Michael Seelinger,et al.  Automatic visual guidance of a forklift engaging a pallet , 2006, Robotics Auton. Syst..

[13]  Dariu Gavrila,et al.  Pedestrian Detection from a Moving Vehicle , 2000, ECCV.

[14]  Emilio Frazzoli,et al.  Closed-loop pallet manipulation in unstructured environments , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Enrico Bertolazzi,et al.  Pallet Pose Estimation with LIDAR and Vision for Autonomous Forklifts , 2009 .

[16]  L. Baglivo,et al.  An object localization and reaching method for wheeled mobile robots using laser rangefinder , 2008, 2008 4th International IEEE Conference Intelligent Systems.

[17]  Jonathan M. Roberts,et al.  Vision‐based operations of a large industrial vehicle: Autonomous hot metal carrier , 2008, J. Field Robotics.

[18]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[19]  Bernardo Wagner,et al.  Variable Pallet Pick-Up for Automatic Guided Vehicles in Industrial Environments , 2006, 2006 IEEE Conference on Emerging Technologies and Factory Automation.

[20]  Minhwan Kim,et al.  Real-Time Positioning and Orienting of Pallets Based on Monocular Vision , 2008, 2008 20th IEEE International Conference on Tools with Artificial Intelligence.

[21]  Robert Pless,et al.  Extrinsic calibration of a camera and laser range finder (improves camera calibration) , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).