Integrated computer-aided forensic case analysis, presentation, and documentation based on multimodal 3D data.

Three-dimensional (3D) crime scene documentation using 3D scanners and medical imaging modalities like computed tomography (CT) and magnetic resonance imaging (MRI) are increasingly applied in forensic casework. Together with digital photography, these modalities enable comprehensive and non-invasive recording of forensically relevant information regarding injuries/pathologies inside the body and on its surface. Furthermore, it is possible to capture traces and items at crime scenes. Such digitally secured evidence has the potential to similarly increase case understanding by forensic experts and non-experts in court. Unlike photographs and 3D surface models, images from CT and MRI are not self-explanatory. Their interpretation and understanding requires radiological knowledge. Findings in tomography data must not only be revealed, but should also be jointly studied with all the 2D and 3D data available in order to clarify spatial interrelations and to optimally exploit the data at hand. This is technically challenging due to the heterogeneous data representations including volumetric data, polygonal 3D models, and images. This paper presents a novel computer-aided forensic toolbox providing tools to support the analysis, documentation, annotation, and illustration of forensic cases using heterogeneous digital data. Conjoint visualization of data from different modalities in their native form and efficient tools to visually extract and emphasize findings help experts to reveal unrecognized correlations and thereby enhance their case understanding. Moreover, the 3D case illustrations created for case analysis represent an efficient means to convey the insights gained from case analysis to forensic non-experts involved in court proceedings like jurists and laymen. The capability of the presented approach in the context of case analysis, its potential to speed up legal procedures and to ultimately enhance legal certainty is demonstrated by introducing a number of representative forensic cases.

[1]  Markus Hadwiger,et al.  Real-time volume graphics , 2006, SIGGRAPH '04.

[2]  Xavier Décoret,et al.  Dynamic label placement for improved interactive exploration , 2008, NPAR.

[3]  Ronald Fedkiw,et al.  Level set methods and dynamic implicit surfaces , 2002, Applied mathematical sciences.

[4]  Dieter Schmalstieg,et al.  Ray casting of multiple volumetric datasets with polyhedral boundaries on manycore GPUs , 2009, ACM Trans. Graph..

[5]  Anders Ynnerman,et al.  Multi-Touch Table System for Medical Visualization: Application to Orthopedic Surgery Planning , 2011, IEEE Transactions on Visualization and Computer Graphics.

[6]  Martin Urschler,et al.  Intuitive presentation of clinical forensic data using anonymous and person-specific 3D reference manikins. , 2014, Forensic science international.

[7]  Martin Urschler,et al.  Interactive 2D/3D Image Denoising and Segmentation Tool for Medical Applications , 2014 .

[8]  Petra Urbanová,et al.  Testing photogrammetry-based techniques for three-dimensional surface documentation in forensic pathology. , 2015, Forensic science international.

[9]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[10]  L. Ebner,et al.  Postmortem whole-body MRI in traumatic causes of death. , 2012, AJR. American journal of roentgenology.

[11]  Lena Maier-Hein,et al.  Mobile markerless augmented reality and its application in forensic medicine , 2015, International Journal of Computer Assisted Radiology and Surgery.

[12]  Dieter Schmalstieg,et al.  Forensic-Case Analysis: From 3D Imaging to Interactive Visualization , 2012, IEEE Computer Graphics and Applications.

[13]  Stefan Weber,et al.  Virtobot—a multi‐functional robotic system for 3D surface scanning and automatic post mortem biopsy , 2010, The international journal of medical robotics + computer assisted surgery : MRCAS.

[14]  Peter Mygind Leth,et al.  The use of CT scanning in forensic autopsy , 2007, Forensic science, medicine, and pathology.

[15]  Anders Ynnerman,et al.  Full Body Virtual Autopsies using a State-of-the-art Volume Rendering Pipeline , 2006, IEEE Transactions on Visualization and Computer Graphics.

[16]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[17]  M. Thali,et al.  Essentials of forensic post-mortem MR imaging in adults. , 2014, The British journal of radiology.

[18]  Stefan Leutenegger,et al.  ElasticFusion: Dense SLAM Without A Pose Graph , 2015, Robotics: Science and Systems.

[19]  David Y. Y. Yun,et al.  Constructive solid geometry: a symbolic computation approach , 1986, SYMSAC '86.

[20]  M. Thali,et al.  VIRTOPSY - the Swiss virtual autopsy approach. , 2007, Legal medicine.

[21]  C Villa,et al.  Virtual animation of victim-specific 3D models obtained from CT scans for forensic reconstructions: Living and dead subjects. , 2017, Forensic science international.

[22]  Anders Ynnerman,et al.  Local Histograms for Design of Transfer Functions in Direct Volume Rendering , 2006, IEEE Transactions on Visualization and Computer Graphics.

[23]  Michael J. Thali,et al.  Reconstruction and 3D visualisation based on objective real 3D based documentation , 2011, Forensic Science, Medicine, and Pathology.

[24]  Martin Urschler,et al.  Integrierte computerunterstützte Analyse und visuelle Aufbereitung forensischer Fälle basierend auf multimodaler 3D Bildgebung , 2013 .

[25]  Martin Urschler,et al.  Assessment of fiducial markers to enable the co-registration of photographs and MRI data. , 2015, Forensic science international.

[26]  P. Ljung,et al.  State‐of‐the‐art of visualization in post‐mortem imaging , 2012, APMIS : acta pathologica, microbiologica, et immunologica Scandinavica.

[27]  M. Thali,et al.  Virtopsy: forensic traumatology of the subcutaneous fatty tissue; multislice computed tomography (MSCT) and magnetic resonance imaging (MRI) as diagnostic tools. , 2004, Journal of forensic sciences.

[28]  Michael J Thali,et al.  Accident or homicide--virtual crime scene reconstruction using 3D methods. , 2013, Forensic science international.

[29]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[30]  Damian Schofield,et al.  Three-Dimensional Computer Visualization of Forensic Pathology Data , 2004, The American journal of forensic medicine and pathology.

[31]  Milan Sonka,et al.  Image pre-processing , 1993 .

[32]  Christina Jacobsen,et al.  Forensic 3D documentation of bodies: Simple and fast procedure for combining CT scanning with external photogrammetry data , 2017 .

[33]  Eva Scheurer,et al.  Contrast of artificial subcutaneous hematomas in MRI over time , 2015, International Journal of Legal Medicine.

[34]  M. Thali,et al.  The Virtopsy Approach: 3D Optical and Radiological Scanning and Reconstruction in Forensic Medicine , 2009 .

[35]  Dieter Schmalstieg,et al.  Dynamic Label Placement for Forensic Case Visualization , 2017, EuroVis.

[36]  Tomas Akenine-Möller,et al.  Real-time rendering , 1997 .