Guidance and Visualization of Optimized Packing Solutions

Packing optimization is a challenging and time-consuming task for a number of industry and logistics applications. Efficient packing can reduce the cost of storage and shipping and also guarantee that damage will not occur during shipping. To help address this problem, we propose a spatial augmented reality-based support system for assisting workers with packing optimization. Our packing support system first uses an RGB-D camera to acquire color and depth information of the items to be packed and the destination container. Then, object segmentation and dimension estimation are simultaneously carried out, and the position and orientation of packing items inside the container are calculated using a bin-packing algorithm. Finally, the optimized packing instructions are projected onto the user’s work area. We then developed and tested two user interfaces (UI) for visualizing instructions called Rotation and Object Movement. Experimental results showed that both methods help reduce packing time up to 57.89% in Rotation and 55.63% in Object Movement, compared to a non-UI method.

[1]  Ellen R. Girden,et al.  ANOVA: Repeated Measures , 1991 .

[2]  Richard M. Karp,et al.  An efficient approximation scheme for the one-dimensional bin-packing problem , 1982, 23rd Annual Symposium on Foundations of Computer Science (sfcs 1982).

[3]  Bruce H. Thomas,et al.  Improving procedural task performance with Augmented Reality annotations , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[4]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[5]  Andrea Lodi,et al.  Two-dimensional packing problems: A survey , 2002, Eur. J. Oper. Res..

[6]  Bruce H. Thomas,et al.  Applying spatial augmented reality to facilitate in-situ support for automotive spot welding inspection , 2011, VRCAI.

[7]  Kathryn A. Dowsland,et al.  A comparative review of 3D container loading algorithms , 2016, Int. Trans. Oper. Res..

[8]  Claudio Barbieri da Cunha,et al.  The logic of logistics: theory, algorithms and applications for logistics management , 1999 .

[9]  Bruce H. Thomas,et al.  Spatial Augmented Reality User Interface Techniques for Room Size Modelling Tasks , 2014, AUIC.

[10]  Daniele Vigo,et al.  The Three-Dimensional Bin Packing Problem , 2000, Oper. Res..

[11]  Matthew Turk,et al.  TranslatAR: A mobile augmented reality translator , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[12]  Greg Kipper,et al.  Augmented Reality: An Emerging Technologies Guide to AR , 2012 .

[13]  Teodor Gabriel Crainic,et al.  Extreme Point-Based Heuristics for Three-Dimensional Bin Packing , 2008, INFORMS J. Comput..

[14]  Luigi di Stefano,et al.  Augmented Reality for Aircraft Maintenance Training and Operations Support , 2011, IEEE Computer Graphics and Applications.

[15]  Markus Neuhäuser,et al.  Wilcoxon Signed Rank Test , 2006 .

[16]  J. A. George,et al.  A heuristic for packing boxes into a container , 1980, Comput. Oper. Res..

[17]  Dimitrios Buhalis,et al.  Smartphone Augmented Reality Applications for Tourism , 2012 .

[18]  Ross T. Smith,et al.  Object-based touch manipulation for remote guidance of physical tasks , 2014, SUI.

[19]  S. Holm A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[20]  E. Dube OPTIMIZING THREE-DIMENSIONAL BIN PACKING THROUGH SIMULATION , 2006 .

[21]  Ramesh Raskar,et al.  Modern approaches to augmented reality: introduction to current approaches , 2006, SIGGRAPH Courses.

[22]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[23]  A. Abramov,et al.  Decision Support Systems in Transport Logistics , 2022 .

[24]  Hirokazu Kato,et al.  Work step indication with grid-pattern projection for demented senior people , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[25]  James T. Moore,et al.  The Distributer's Three-Dimensional Pallet-Packing Problem: A Human Intelligence-Based Heuristic Approach , 2012 .

[26]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.