Luggage visualization and virtual unpacking

We present a system for luggage visualization where any object is clearly distinguishable from its neighbors. It supports virtual unpacking by visually moving any object away from its original pose. To achieve these, we first apply a volume segmentation guided by a confidence measure that recursively splits connected regions until semantically meaningful objects are obtained, and a label volume whose voxels specifying the object IDs is generated. The original luggage dataset and the label volume are visualized by volume rendering. Through an automatic coloring algorithm, any pair of objects whose projections are adjacent in an image are assigned distinct hues that are modulated onto a transfer function to both reduce rendering cost as well as to improve the smoothness across object boundaries. We have designed a layered framework to efficiently render a scene mixed with packed luggage, animated unpacking objects, and already unpacked objects put aside for further inspection. The system uses GPU to quickly select unpackable objects that are not blocked by others to make the unpacking plausible.

[1]  Dinesh Manocha,et al.  Interactive visibility ordering and transparency computations among geometric primitives in complex environments , 2005, SIGGRAPH Courses.

[2]  Reinhard Klein,et al.  Depth-peeling for texture-based volume rendering , 2003, 11th Pacific Conference onComputer Graphics and Applications, 2003. Proceedings..

[3]  Samuel Moon-Ho Song,et al.  Three-dimensional electronic unpacking of packed bags using 3-D CT images , 2009, Electronic Imaging.

[4]  Stefan Bruckner,et al.  Flexible Direct Multi-Volume Rendering in Dynamic Scenes , 2004, VMV.

[5]  Christopher V. Alvino,et al.  The Piecewise Smooth Mumford–Shah Functional on an Arbitrary Graph , 2009, IEEE Transactions on Image Processing.

[6]  Markus Hadwiger,et al.  High-quality two-level volume rendering of segmented data sets on consumer graphics hardware , 2003, IEEE Visualization, 2003. VIS 2003..

[7]  David Salesin,et al.  Automated generation of interactive 3D exploded view diagrams , 2008, SIGGRAPH 2008.

[8]  Stefan Bruckner,et al.  Exploded Views for Volume Data , 2006, IEEE Transactions on Visualization and Computer Graphics.

[9]  Wei Li,et al.  Multi-layer Volume Ray Casting on GPU , 2010, VG@Eurographics.

[10]  David Salesin,et al.  Automated generation of interactive 3D exploded view diagrams , 2008, ACM Trans. Graph..

[11]  Leo Grady,et al.  Isoperimetric graph partitioning for image segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Stefan Bruckner,et al.  TECHNICAL REPORT VolumeShop: An Interactive System for Direct Volume , 2022 .

[13]  Wei Chen,et al.  Perception-Based Transparency Optimization for Direct Volume Rendering , 2009, IEEE Transactions on Visualization and Computer Graphics.

[14]  Markus Hadwiger,et al.  High-Quality Multimodal Volume Rendering for Preoperative Planning of Neurosurgical Interventions , 2007, IEEE Transactions on Visualization and Computer Graphics.

[15]  Kevin J. Kennedy,et al.  The bacterial community structure during bioleaching of a low-grade nickel sulphide ore in stirred-tank reactors at different combinations of temperature and pH , 2010 .

[16]  Dieter Schmalstieg,et al.  Ray casting of multiple volumetric datasets with polyhedral boundaries on manycore GPUs , 2009, SIGGRAPH 2009.

[17]  Cass W. Everitt,et al.  Interactive Order-Independent Transparency , 2001 .

[18]  Timo Kohlberger,et al.  Automatic Segmentation of Unknown Objects, with Application to Baggage Security , 2012, ECCV.

[19]  Cláudio T. Silva,et al.  Interactive rendering of large unstructured grids using dynamic level-of-detail , 2005, VIS 05. IEEE Visualization, 2005..

[20]  Dinesh Manocha,et al.  CULLIDE: interactive collision detection between complex models in large environments using graphics hardware , 2003, HWWS '03.

[21]  Jianlong Zhou,et al.  Automatic Transfer Function Generation Using Contour Tree Controlled Residue Flow Model and Color Harmonics , 2009, IEEE Transactions on Visualization and Computer Graphics.

[22]  Stefan Bruckner,et al.  Flexible direct multi-volume rendering in interactive scenes , 2004 .

[23]  Dieter Schmalstieg,et al.  Ray casting of multiple volumetric datasets with polyhedral boundaries on manycore GPUs , 2009, ACM Trans. Graph..