AnthroVis: visual analysis of 3D mesh ensembles for forensic anthropology

Digital approaches to shape comparison and analysis play a very important role in forensic anthropology. New methods are still emerging and the whole area is experiencing a shift from traditional 2D image data to processing of 3D meshes. Therefore, the visual exploration of 3D meshes and methods for their visual comparison play a crucial role in the anthropological research. In our paper we present a novel AnthroVis tool for visual analysis of 3D mesh ensembles, which was designed in tight cooperation with the domain experts. It aims to enhance their workflow by introducing several visualizations that help to understand the similarities and differences between 3D meshes. AnthroVis in general consists of three methods, which serve as a guidance in the process of the comparison of two or more mesh ensembles. The first method, based on the idea of interactive heat plots, provides an overview of pairwise comparisons in a set of analyzed meshes and enables their filtering and sorting. The second method consists of anthropologically relevant cross-cuts indicating the variability through the set of meshes. The last method uses superimposition principle for pairs of meshes equipped with several visual enhancements indicating local mesh differences in three-dimensional space. The domain expert evaluation was performed primarily on facial images, but the tool proved to be applicable to other areas of forensic anthropology as well. Its usefulness is demonstrated by three case studies describing the real situations and problems encountered by anthropologists in forensic casework.

[1]  Yingbo Zhai,et al.  Combining least absolute shrinkage and selection operator (LASSO) and heat map visualization for biomarkers detection of LGL leukemia , 2015, 2015 Systems and Information Engineering Design Symposium.

[2]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Ivan Viola,et al.  MoleCollar and Tunnel Heat Map Visualizations for Conveying Spatio‐Temporo‐Chemical Properties Across and Along Protein Voids , 2015, Comput. Graph. Forum.

[4]  Hans Hagen,et al.  IRIS: Illustrative Rendering for Integral Surfaces , 2010, IEEE Transactions on Visualization and Computer Graphics.

[5]  Petra Urbanová,et al.  Testing photogrammetry-based techniques for three-dimensional surface documentation in forensic pathology. , 2015, Forensic science international.

[6]  Nanning Zheng,et al.  Scaling iterative closest point algorithm for registration of m-D point sets , 2010, J. Vis. Commun. Image Represent..

[7]  Laixin Zhou,et al.  Metrics and visualization tools for surface mesh comparison , 2001, IS&T/SPIE Electronic Imaging.

[8]  Yan Wang,et al.  EI3D: Expression-invariant 3D face recognition based on feature and shape matching , 2016, Pattern Recognit. Lett..

[9]  Alexander M. Bronstein,et al.  Three-Dimensional Face Recognition , 2005, International Journal of Computer Vision.

[10]  Alan C. Bovik,et al.  Anthropometric 3D Face Recognition , 2010, International Journal of Computer Vision.

[11]  Franz-Erich Wolter,et al.  YaDiV—an open platform for 3D visualization and 3D segmentation of medical data , 2011, The Visual Computer.

[12]  Hans-Christian Hege,et al.  amira: A Highly Interactive System for Visual Data Analysis , 2005, The Visualization Handbook.

[13]  Charl P. Botha,et al.  Image-based rendering of intersecting surfaces for dynamic comparative visualization , 2011, The Visual Computer.

[14]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Hiromi T. Tanaka,et al.  Curvature-based face surface recognition using spherical correlation. Principal directions for curved object recognition , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[16]  Igor Chalás,et al.  3D Virtual Model Database of Human Faces: Applications inanthropology and forensic sciences , 2014 .

[17]  Rüdiger Westermann,et al.  Screen-space silhouettes for visualizing ensembles of 3D isosurfaces , 2016, 2016 IEEE Pacific Visualization Symposium (PacificVis).

[18]  Thomas Ertl,et al.  Comparative Visualization of Molecular Surfaces Using Deformable Models , 2014, Comput. Graph. Forum.

[19]  Stefan Bruckner,et al.  Volume Analysis Using Multimodal Surface Similarity , 2011, IEEE Transactions on Visualization and Computer Graphics.

[20]  Victoria Interrante,et al.  Conveying the 3D Shape of Smoothly Curving Transparent Surfaces via Texture , 1997, IEEE Trans. Vis. Comput. Graph..

[21]  Dimitrios Hatzinakos,et al.  Iterative Closest Normal Point for 3D Face Recognition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Katarína Furmanová Visualization Techniques for 3D Facial Comparison , 2015 .

[23]  Paolo Cignoni,et al.  MeshLab: an Open-Source Mesh Processing Tool , 2008, Eurographics Italian Chapter Conference.

[24]  Silvia Born,et al.  Illustrative Stream Surfaces , 2010, IEEE Transactions on Visualization and Computer Graphics.

[25]  J. van Leeuwen,et al.  Articulated Motion and Deformable Objects , 2002, Lecture Notes in Computer Science.

[26]  Liming Chen,et al.  Learning the Spherical Harmonic Features for 3-D Face Recognition , 2013, IEEE Trans. Image Process..

[27]  Zhaohui Wu,et al.  Automatic 3D face verification from range data , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[28]  Michael Wimmer,et al.  YMCA — Your mesh comparison application , 2014, 2014 IEEE Conference on Visual Analytics Science and Technology (VAST).

[29]  Dongjie Chen,et al.  3D Face Hierarchical Recognition Based on Geometric and Curvature Features , 2009, 2009 International Symposium on Computer Network and Multimedia Technology.

[30]  Yun Jang,et al.  Smart Transparency for Illustrative Visualization of Complex Flow Surfaces , 2013, IEEE Transactions on Visualization and Computer Graphics.

[31]  Russell M. Taylor,et al.  Visualizing intersecting surfaces with nested-surface techniques , 2005, VIS 05. IEEE Visualization, 2005..

[32]  Gary Siuzdak,et al.  An interactive cluster heat map to visualize and explore multidimensional metabolomic data , 2015, Metabolomics.

[33]  Robert B. Fisher,et al.  Articulated Motion and Deformable Objects, 4th International Conference, AMDO 2006, Port d'Andratx, Mallorca, Spain, July 11-14, 2006, Proceedings , 2006, AMDO.

[34]  Samuel S. Silva,et al.  PolyMeCo - a polygonal mesh comparison tool , 2005, Ninth International Conference on Information Visualisation (IV'05).

[35]  Martin Rumpf,et al.  Anisotropic Diffusion in Vector Field Visualization on Euclidean Domains and Surfaces , 2000, IEEE Trans. Vis. Comput. Graph..

[36]  Alexander M. Bronstein,et al.  Expression-Invariant Representations of Faces , 2007, IEEE Transactions on Image Processing.

[37]  Feng Han,et al.  3D human face recognition using point signature , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).