Automated detection of euro pallet loads by interpreting PMD camera depth images

In this study, a novel approach for the detection of parcel loading positions on a pallet is presented. This approach was realized as a substantial change in comparison with traditional system design of contour detection in de-palletizing processes. Complex 3D-vision systems, costly laser scanners or throughput decreasing local sensor solutions integrated in grippers are substituted by a low-cost photonic mixing device (PMD) camera. By combining PMD technology and a predetermined model of loading situations, stored during assembling the pallet, this approach can compensate for the drawbacks of each respective system. An essential part of the approach are computer-graphics methods specific to the given problem to both detect the deviation between the nominal and the actual loading position and if necessary an automated correction of the packaging scheme. From an economic point of view, this approach can decrease the costs of mandatory contour checking in automated de-palletizing processes.

[2]  Peter Nilsson.  3D-Vision Guided Robotics for Material Handling , 2010, ISR/ROBOTIK.

[3]  Hüsnü Yenigün,et al.  2-D localization and identification based on SAW ID-tags at 2.5 GHz , 2003 .

[4]  Andreas Kolb,et al.  Calibration of the intensity-related distance error of the PMD TOF-camera , 2007, SPIE Optics East.

[5]  Heinz Wörn,et al.  Real-time Framework for Bin-Picking Problem using Advantages of PMD-Technology , 2008 .

[6]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Simon Winkelbach,et al.  RANSAM for Industrial Bin-Picking , 2010, ISR/ROBOTIK.

[8]  Dimitrios I. Kosmopoulos,et al.  An efficient depalletizing system based on 2D range imagery , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[9]  Hossam S. Hassanein,et al.  3D Passive Tag Localization Schemes for Indoor RFID Applications , 2010, 2010 IEEE International Conference on Communications.

[10]  Peter Rinza,et al.  Nutzwert-Kosten-Analyse , 1992 .

[11]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[12]  S. Foix,et al.  Lock-in Time-of-Flight (ToF) Cameras: A Survey , 2011, IEEE Sensors Journal.

[13]  Ales Pochyly,et al.  Robotic Vision for Bin-Picking Applications of Various Objects , 2010, ISR/ROBOTIK.

[14]  Kay Boehnke.  Object localization in range data for robotic bin picking , 2007, 2007 IEEE International Conference on Automation Science and Engineering.

[15]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[16]  H. A. David,et al.  THE DISTRIBUTION OF THE RATIO, IN A SINGLE NORMAL SAMPLE, OF RANGE TO STANDARD DEVIATION , 1954 .

[17]  Sven Parusel,et al.  Cooperative bin-picking with Time-of-Flight camera and impedance controlled DLR lightweight robot III , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Bernd Scholz-Reiter,et al.  Towards 3D object recognition for universal goods in logistic , 2010 .

[19]  A. Kirchheim,et al.  Robotics-logistics: Challenges for automation of logistic processes , 2008, 2008 IEEE International Conference on Automation and Logistics.

[20]  Christian Prasse,et al.  Concept of automated load detection for de-palletizing using depth images and RFID data , 2011, 2011 IEEE International Conference on Control System, Computing and Engineering.

[21]  Sang-Cheol Lee,et al.  Reducing localization ambiguity of immobile passive UHF RFID tagged physical objects , 2011, 2011 8th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[22]  Ramez Elmasri,et al.  Passive UHF RFID-Based Localization Using Detection of Tag Interference on Smart Shelf , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[23]  Reinhard Koch,et al.  Time-of-Flight Sensors in Computer Graphics , 2009, Eurographics.

[24]  Yunhao Liu,et al.  LANDMARC: Indoor Location Sensing Using Active RFID , 2004, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003)..

[25]  Ludger Overmeyer,et al.  RFID-assistierte Stückguterfassung und -handling anhand eines kognitiven Robotersystems , 2010 .

[26]  Steven B. Skaar,et al.  Robotic de-palletizing using uncalibrated vision and 3D laser-assisted image analysis , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Bianca Hagebeuker,et al.  Mehrdimensionale Objekterfassung mittels PMD­Sensorik , 2008 .

[28]  Daesik Kim,et al.  Development of structured light based bin picking system using primitive models , 2009, 2009 IEEE International Symposium on Assembly and Manufacturing.

[29]  Bernd Scholz-Reiter,et al.  Modeling Distance Nonlinearity in ToF Cameras and Correction Based on Integration Time Offsets , 2011, CIARP.

[30]  Benedikt Kaiser.  Bildverarbeitung für ein generisches Entladesystem , 2009 .

[31]  M. Vasmi Abidi,et al.  Laser ranging and video imaging for bin picking Faysal , 2002 .

[32]  J. R. Smith,et al.  Optical localization of passive UHF RFID tags with integrated LEDs , 2012, 2012 IEEE International Conference on RFID (RFID).

[33]  Petar M. Djuric,et al.  A Radio Frequency Identification System for accurate indoor localization , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[34]  Paul F. Whelan,et al.  A bin picking system based on depth from defocus , 2003, Machine Vision and Applications.

[35]  J. Norberto Pires,et al.  High efficient robotic de-palletizing system for the non-flat ceramic industry , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[36]  W. Weihs,et al.  Detection and Classification of Moving Objects-Stereo or Time-of-Flight Images , 2006, 2006 International Conference on Computational Intelligence and Security.

[37]  A. Meyer,et al.  Manufacturing operations in Europe:: Where do we go next? , 1998 .

[38]  Ivan Marsic,et al.  Non-intrusive localization of passive RFID tagged objects in an indoor workplace , 2011, 2011 IEEE International Conference on RFID-Technologies and Applications.