The big puzzle: a critical review of virtual re-association methods for fragmented human remains in a DVI context'

ABSTRACT During a Disaster Victims Identification (DVI) mission, international protocols rely on interdisciplinary work, especially between specialists from forensic imaging and anthropology. In case of air crashes or explosions, DVI units may face thousands of fragmented human remains (FHRs). The physical re-association of FHRs and the identification process is very complex and challenging, and relies upon expensive and destructive DNA analysis. A virtual re-association (VRA) of these fragments, using Multidetector Computed Tomography (MDCT), could be a helpful tool in forensic anthropology analysis, as it could assist in reducing the number of DNA samples. However, there is no standardized protocol for including such an approach into a DVI procedure. The aim of this study was to summarize and analyze existing techniques through a systematic review and to develop a protocol for virtual re-association of FHRs, adapted to the DVI context. A keyword-based literature search was conducted, focusing on the VRA methods using MDCT imaging and 3D surface scan methodology. Reviews and primary articles, published between 2005 and 2020 in the fields of forensic anthropology, paleoanthropology, archaeology, and fracture reduction surgery were sorted out. A total of 45 publications were selected and analyzed based on their content and relevance. The results show that research on the re-association of FHRs increased significantly during the last five years. Seven steps regarding the MDCT-based method for the virtual re-association of FHRs could be identified: acquisition of 3D-images, segmentation of the MDCT-data, post-processing and surface generation, identification of intact and fracture surfaces, identification and registration of matching fragments, and validation of the re-association. The literature is surprisingly sparse regarding the FHRs re-association as a forensic tool, and mainly consists in case reports, whereas validated methods were presented in archaeology and surgery publications. However, we were able to adapt the MDCT-based approach for the virtual re-association of the FHRs and propose an innovative protocol for DVI missions. This protocol includes the needed details, from the acquisition of MDCT imaging to the virtual re-association of 3D models and its validation. Each step has to be fully tested, adapted and validated in future studies.

[1]  D. Ubelaker,et al.  Contributions of forensic anthropology to positive scientific identification: a critical Review , 2018, Forensic sciences research.

[2]  Andrew R. Willis,et al.  Improving inter-fragmentary alignment for virtual 3D reconstruction of highly fragmented bone fractures , 2009, Medical Imaging.

[3]  Lorenzo Campana,et al.  Virtual anthropology: a preliminary test of macroscopic observation versus 3D surface scans and computed tomography (CT) scans , 2020, Forensic sciences research.

[4]  Ann H Ross,et al.  The virtual approach to the assessment of skeletal injuries in human skeletal remains of forensic importance. , 2017, Journal of forensic and legal medicine.

[5]  L. Bellucci,et al.  Virtual Anthropology and its Application in Cultural Heritage Studies , 2018, Studies in Conservation.

[6]  G. Székely,et al.  An interactive surgical planning tool for acetabular fractures: initial results , 2010, Journal of orthopaedic surgery and research.

[7]  Juan José Jiménez-Delgado,et al.  Computer assisted preoperative planning of bone fracture reduction: Simulation techniques and new trends , 2016, Medical Image Anal..

[8]  Félix Paulano,et al.  3D segmentation and labeling of fractured bone from CT images , 2014 .

[9]  Naomichi Ogihara,et al.  Virtual reconstruction of the Neanderthal Amud 1 cranium. , 2015, American journal of physical anthropology.

[10]  Filip Malmberg,et al.  BoneSplit - A 3D Texture Painting Tool for Interactive Bone Separation in CT Images , 2015, WSCG 2015.

[11]  Mingquan Zhou,et al.  Template-Guided 3D Fragment Reassembly Using GDS , 2018, IGTA.

[12]  Olivier Delémont,et al.  CT-scan vs. 3D surface scanning of a skull: first considerations regarding reproducibility issues , 2017, Forensic sciences research.

[13]  Tanya Uldin.  Virtual anthropology : the forensic approach , 2016 .

[14]  D. Steadman,et al.  The Effects of Chemical and Heat Maceration Techniques on the Recovery of Nuclear and Mitochondrial DNA from Bone * , 2006, Journal of forensic sciences.

[15]  Simon Winkelbach,et al.  Pairwise Matching of 3D Fragments Using Cluster Trees , 2008, International Journal of Computer Vision.

[16]  Abraham Johnson,et al.  Effective approaches to three-dimensional digital reconstruction of fragmented human skeletal remains using laser surface scanning , 2020, Forensic science international. Synergy.

[17]  Ursula Buck,et al.  Haptics in forensics: the possibilities and advantages in using the haptic device for reconstruction approaches in forensic science. , 2008, Forensic science international.

[18]  Cristina Cattaneo,et al.  Postmortem imaging of perimortem skeletal trauma. , 2019, Forensic science international.

[19]  Suchendra M. Bhandarkar,et al.  Virtual multi-fracture craniofacial reconstruction using computer vision and graph matching , 2009, Comput. Medical Imaging Graph..

[20]  Yong Kim,et al.  Quantitative Analysis of Three-dimensional Rendered Imaging of the Human Skull Acquired from Multi-Detector Row Computed Tomography , 2002, Journal of Digital Imaging.

[21]  Gábor Székely,et al.  A scale‐space curvature matching algorithm for the reconstruction of complex proximal humeral fractures , 2018, Medical Image Anal..

[22]  Ali Mustafa,et al.  Computerized reconstruction of fragmentary skeletal remains. , 2017, Forensic science international.

[23]  Helmut Pottmann,et al.  Reassembling fractured objects by geometric matching , 2006, ACM Trans. Graph..

[24]  Jiing-Yih Lai,et al.  Algorithm for segmentation and reduction of fractured bones in computer-aided preoperative surgery , 2016, ICBBE '16.

[25]  Jiing-Yih Lai,et al.  Integration of computer-assisted fracture reduction system and a hybrid 3-DOF-RPS mechanism for assisting the orthopedic surgery , 2018 .

[26]  H. Rousseau,et al.  Virtual anthropology and forensic identification using multidetector CT. , 2014, The British journal of radiology.

[27]  A new OH5 reconstruction with an assessment of its uncertainty. , 2011, Journal of human evolution.

[28]  Terence Essomba,et al.  Kinematic analysis and evaluation of a hybrid mechanism for computer assisted bone reduction surgery , 2019 .

[29]  Gregory E. Berg,et al.  Skeletal Identification by Radiographic Comparison of the Cervicothoracic Region on Chest Radiographs , 2018 .

[30]  A. Brough,et al.  Postmortem computed tomography (PMCT) and disaster victim identification , 2015, La radiologia medica.

[31]  Luca Di Angelo,et al.  Review of computer-based methods for archaeological ceramic sherds reconstruction , 2020 .

[32]  C. Sforza,et al.  Does the choice of the reference model affect the results of 3D-3D superimposition procedure? A comparison of different protocols for personal identification , 2021, International Journal of Legal Medicine.

[33]  Ravindra Hegadi,et al.  Automated Fractured Bone Segmentation and Labeling from CT Images , 2019, J. Medical Syst..

[34]  N. Ogihara,et al.  Computerized assembly of neurocranial fragments based on surface extrapolation , 2013 .

[35]  Ingrid Carlbom,et al.  A haptics-assisted cranio-maxillofacial surgery planning system for restoring skeletal anatomy in complex trauma cases , 2013, International Journal of Computer Assisted Radiology and Surgery.

[36]  N. Berger,et al.  Imaging in forensic radiology: an illustrated guide for postmortem computed tomography technique and protocols , 2014, Forensic Science, Medicine, and Pathology.

[37]  Katherine Brown,et al.  Reconstruction and physical fit analysis of fragmented skeletal remains using 3D imaging and printing , 2020, Forensic Science International: Reports.

[38]  Zhongke Wu,et al.  An automatic positioning algorithm for archaeological fragments , 2016, VRCAI.

[39]  Jan Nordin,et al.  A Survey of Computer Methods in Reconstruction of 3D Archaeological Pottery Objects , 2015 .

[40]  Juan José Jiménez-Delgado,et al.  Identification of fracture zones and its application in automatic bone fracture reduction , 2017, Comput. Methods Programs Biomed..

[41]  Abraham Johnson,et al.  Case report: Digital restoration of fragmented non-human skull , 2020 .

[42]  A. Mundorff.  Anthropologist-directed triage: three distinct mass fatality events involving fragmentation of human remains , 2008 .

[43]  Beat Schmutz,et al.  Effects of CT image segmentation methods on the accuracy of long bone 3D reconstructions. , 2011, Medical engineering & physics.

[44]  S. Schlager,et al.  Digital reconstruction of the Ceprano calvarium (Italy), and implications for its interpretation , 2017, Scientific Reports.

[45]  S. Benazzi,et al.  Geometric morphometric methods for three-dimensional virtual reconstruction of a fragmented cranium: the case of Angelo Poliziano , 2009, International Journal of Legal Medicine.

[46]  Stefano Benazzi,et al.  Comparing 3-dimensional virtual methods for reconstruction in craniomaxillofacial surgery. , 2011, Journal of oral and maxillofacial surgery : official journal of the American Association of Oral and Maxillofacial Surgeons.

[47]  G. Weber,et al.  Virtual anthropology. , 2015, American journal of physical anthropology.

[48]  Angi M. Christensen,et al.  The use of cone beam computed tomography in forensic radiology , 2014 .

[49]  Michael J. Thali,et al.  Estimation of sex and age of “virtual skeletons”–a feasibility study , 2009, European Radiology.

[50]  G. Quatrehomme,et al.  Anatomical reconstruction of fragments of burned human bones: a necessary means for forensic identification. , 1998, Forensic science international.

[51]  J. Tonetti,et al.  Computer-assisted surgery in acetabular fractures: Virtual reduction of acetabular fracture using the first patient-specific biomechanical model simulator. , 2018, Orthopaedics & traumatology, surgery & research : OTSR.

[52]  Andrew R. Willis,et al.  3D reconstruction of highly fragmented bone fractures , 2007, SPIE Medical Imaging.

[53]  S. Rottier,et al.  Recovery Methods for Cremated Commingled Remains: Analysis and Interpretation of Small Fragments Using a Bioarchaeological Approach , 2014 .

[54]  Wen-Jun Huang,et al.  Computer-assisted virtual preoperative planning in orthopedic surgery for acetabular fractures based on actual computed tomography data , 2016, Computer assisted surgery.

[55]  Jiří Chmelík,et al.  Digital restoration of fragmentary human skeletal remains: Testing the feasibility of virtual reality. , 2019, Journal of forensic and legal medicine.

[56]  A. Mundorff,et al.  Disaster victim identification operations with fragmented, burnt, or commingled remains: experience-based recommendations , 2020, Forensic sciences research.

[57]  Jiing-Yih Lai,et al.  Simultaneous Segmentation of Bone Regions Using Multiple-Level Threshold , 2011 .

[58]  Lanfen Lin,et al.  Joined fragment segmentation for fractured bones using GPU-accelerated shape-preserving erosion and dilation , 2019, Medical & Biological Engineering & Computing.

[59]  C. O'Donnell,et al.  Contribution of postmortem multidetector CT scanning to identification of the deceased in a mass disaster: Experience gained from the 2009 Victorian bushfires. , 2011, Forensic science international.

[60]  S. Grabherr,et al.  Modern post-mortem imaging: an update on recent developments , 2017, Forensic sciences research.

[61]  Abraham Johnson,et al.  Digital reconstruction of fragmented tooth remains in forensic context , 2020 .

[62]  Hugh Tuller,et al.  Spatial Analysis of Mass Grave Mapping Data to Assist in the Reassociation of Disarticulated and Commingled Human Remains , 2008 .

[63]  J Vander Sloten,et al.  Computer-aided planning of reconstructive surgery of the innominate bone: Automated correction proposals , 2007, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[64]  H. H. de Boer,et al.  The role of forensic anthropology in disaster victim identification (DVI): recent developments and future prospects , 2018, Forensic sciences research.

[65]  S. Lautenschlager,et al.  Reconstructing the past: methods and techniques for the digital restoration of fossils , 2016, Royal Society Open Science.