Forensic identification by computer-aided craniofacial superimposition: A survey

Craniofacial superimposition is a forensic process in which a photograph of a missing person is compared with a skull found to determine its identity. After one century of development, craniofacial superimposition has become an interdisciplinary research field where computer sciences have acquired a key role as a complement of forensic sciences. Moreover, the availability of new digital equipment (such as computers and 3D scanners) has resulted in a significant advance in the applicability of this forensic identification technique. The purpose of this contribution is twofold. On the one hand, we aim to clearly define the different stages involved in the computer-aided craniofacial superimposition process. Besides, we aim to clarify the role played by computers in the methods considered. In order to accomplish these objectives, an up-to-date review of the recent works is presented along with a discussion of advantages and drawbacks of the existing approaches, with an emphasis on the automatic ones. Future case studies will be easily categorized by identifying which stage is tackled and which kind of computer-aided approach is chosen to face the identification problem. Remaining challenges are indicated and some directions for future research are given.

[1]  W D Turner,et al.  A novel method of automated skull registration for forensic facial approximation. , 2005, Forensic science international.

[2]  T R Kumari,et al.  Remote control skull positioning device for superimposition studies. , 1992, Forensic science international.

[3]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  FRANCIS GALTON Signaletic Instructions, including the Theory and Practice of Anthropomctrical Identification , 1896, Nature.

[5]  Gatot Lao,et al.  Craniofacial identification in forensic medicine , 1999 .

[6]  J. Clement,et al.  Craniofacial identification by computer-mediated superimposition. , 2006, The Journal of forensic odonto-stomatology.

[7]  G. J. Srinivasan,et al.  Cranio-facial morphanalysis: a new method for enhancing reliability while identifying skulls by photo superimposition. , 2001, Forensic science international.

[8]  Katsushi Ikeuchi,et al.  Modelling from reality , 2001 .

[9]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[10]  Eta S. Berner,et al.  Clinical Decision Support Systems , 1999, Health Informatics.

[11]  D Austin-Smith,et al.  The reliability of skull/photograph superimposition in individual identification. , 1994, Journal of forensic sciences.

[12]  Zicheng Liu,et al.  Model-based bundle adjustment with application to face modeling , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[13]  G J Maat The positioning and magnification of faces and skulls for photographic superimposition. , 1989, Forensic science international.

[14]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[15]  I. Bajnóczky,et al.  A new approach to computer-aided comparison of skull and photograph , 2005, International Journal of Legal Medicine.

[16]  R Enciso,et al.  Three-dimensional visualization of the craniofacial patient: volume segmentation, data integration and animation. , 2003, Orthodontics & craniofacial research.

[17]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[18]  Oscar Cordón,et al.  Automatic 3D Modeling of Skulls by Scatter Search and Heuristic Features , 2009 .

[19]  D. Ranson,et al.  CRANIOFACIAL IDENTIFICATION IN FORENSIC MEDICINE , 1998 .

[20]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Thomas S. Huang,et al.  3D Face Processing: Modeling, Analysis and Synthesis , 2004 .

[22]  Oscar Cordón,et al.  An experimental study on the applicability of evolutionary algorithms to craniofacial superimposition in forensic identification , 2009, Inf. Sci..

[23]  Hitoshi Biwasaka,et al.  The applicability of holography in forensic identification: a fusion of the traditional optical technique and digital technique. , 2005, Journal of forensic sciences.

[24]  Y. Alakoç,et al.  The identification of a dismembered human body: a multidisciplinary approach. , 2003, Forensic science international.

[25]  Sergio Shiguemi Furuie,et al.  Automatic Detection of the Craniometric Points for Craniofacial Identification , 1996 .

[26]  E. Berner,et al.  Clinical Decision Support Systems: Theory and Practice , 1998 .

[27]  Peter G. W. Keen,et al.  Decision support systems : an organizational perspective , 1978 .

[28]  Carl N Stephan,et al.  Further Evidence on the Anatomical Placement of the Human Eyeball for Facial Approximation and Craniofacial Superimposition * , 2009, Journal of forensic sciences.

[29]  NavarroFernando,et al.  Forensic identification by computer-aided craniofacial superimposition , 2011 .

[30]  G. Kane Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol 1: Foundations, vol 2: Psychological and Biological Models , 1994 .

[31]  Oscar Cordón,et al.  Performance evaluation of memetic approaches in 3D reconstruction of forensic objects , 2008, Soft Comput..

[32]  Peter Henry Tu,et al.  A Survey of Tissue-Depth Landmarks for Facial Approximation , 2004 .

[33]  Caroline Wilkinson,et al.  Facial identification of the dead. , 2008, Journal of anatomy.

[34]  Oscar Cordón,et al.  Craniofacial Superimposition in Forensic Identification using Genetic Algorithms , 2007, Third International Symposium on Information Assurance and Security.

[35]  Tania S Douglas,et al.  Image processing for craniofacial landmark identification and measurement: a review of photogrammetry and cephalometry. , 2004, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[36]  Carl N. Stephan,et al.  Methods of Facial Approximation and Skull-Face Superimposition, With Special Consideration of Method Development in Australia , 2008 .

[37]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[38]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[39]  L M Brocklebank,et al.  Development of equipment for the standardization of skull photographs in personal identifications by photographic superimposition. , 1989, Journal of forensic sciences.

[40]  Oscar Cordón,et al.  A scatter search-based technique for pair-wise 3D range image registration in forensic anthropology , 2006, Soft Comput..

[41]  B Scully,et al.  Determining the Validity Of Furue's Method Of Craniofacial Superimposition For Identification , 2002 .

[42]  Zbigniew Michalewicz,et al.  Handbook of Evolutionary Computation , 1997 .

[43]  John Glaister,et al.  Medico-Legal Aspects of the Ruxton Case , 1938, The Indian Medical Gazette.

[44]  H. Grebe Martin R. und Saller K.: Lehrbuch der Anthropologie in systematischer Darstellung 5 . Lieferung (mit Abb. 313 - 354) S. 663 - 838, geh. Preis DM. 26, 40, Gustav Fischer Verlag - Stuttgart (1958). , 1958 .

[45]  A. Albert,et al.  A review of the literature on the aging adult skull and face: implications for forensic science research and applications. , 2007, Forensic science international.

[46]  Gian Luca Marella,et al.  A New Experimental Approach to Computer-Aided Face/Skull Identification in Forensic Anthropology , 2006, The American journal of forensic medicine and pathology.

[47]  Holly E. Rushmeier,et al.  The 3D Model Acquisition Pipeline , 2002, Comput. Graph. Forum.

[48]  Mehmet Yaşar İşcan,et al.  Forensic anthropology of sex and body size , 2005 .

[49]  Oscar Cordón,et al.  Craniofacial Superimposition Based on Genetic Algorithms and Fuzzy Location of Cephalometric Landmarks , 2008, HAIS.

[50]  Skull-Photo Superimposition , 2009, Encyclopedia of Biometrics.

[51]  Daniel Rueckert,et al.  Using Photo-Consistency to Register 2D Optical Images of the Human Face to a 3D Surface Model , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  Masahiko Terajima,et al.  Three-dimensional computer-generated head model reconstructed from cephalograms, facial photographs, and dental cast models. , 2005, American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics.

[53]  F Introna,et al.  Reverse engineering techniques applied to a human skull, for CAD 3D reconstruction and physical replication by rapid prototyping , 2006, Journal of medical engineering & technology.

[54]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[55]  Pavel Krsek,et al.  Superimposition and projective transformation of 3D object. , 2007, Forensic science international.

[56]  Douglas H. Ubelaker,et al.  Computer-Assisted Photographic Superimposition , 1992 .

[57]  Oscar Cordón,et al.  A New Approach to Fuzzy Location of Cephalometric Landmarks in Craniofacial Superimposition , 2009, IFSA/EUSFLAT Conf..

[58]  Jeffrey Horn,et al.  Handbook of evolutionary computation , 1997 .

[59]  Ivo B Alberink,et al.  2D/3D image (facial) comparison using camera matching. , 2006, Forensic science international.

[60]  R B Dorion Photographic superimposition. , 1983, Journal of forensic sciences.

[61]  共立出版株式会社 コンピュータ・サイエンス : ACM computing surveys , 1978 .

[62]  F Introna,et al.  Computer-aided skull/face superimposition. , 1986, The American journal of forensic medicine and pathology.

[63]  C N Stephan,et al.  Assessing facial approximation accuracy: how do resemblance ratings of disparate faces compare to recognition tests? , 2006, Forensic science international.

[64]  Francesca De Crescenzio,et al.  The face of the Poet Dante Alighieri reconstructed by virtual modelling and forensic anthropology techniques , 2009 .

[65]  Katsushi Ikeuchi Modeling from reality , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[66]  Maria Martha Gabriela Pimienta Merlin,et al.  Dimorfismo sexual en una población mexicana. Nuevas fórmulas para la determinación del sexo en el esqueleto postcraneal , 2000 .

[67]  Bingheng Lu,et al.  Rapid prototyping assisted surgery planning and custom implant design , 2009 .

[68]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[69]  S Miyasaka,et al.  Evaluation of anatomical consistency in craniofacial superimposition images. , 1995, Forensic science international.

[70]  Caroline Wilkinson,et al.  Facial reconstruction – anatomical art or artistic anatomy? , 2010, Journal of anatomy.

[71]  W. M. Krogman The human skeleton in forensic medicine. I. , 1963, Postgraduate medicine.

[72]  W A Aulsebrook,et al.  Superimposition and reconstruction in forensic facial identification: a survey. , 1995, Forensic science international.

[73]  Christopher Pincock,et al.  Modeling reality , 2009, Synthese.

[74]  Oscar Cordón,et al.  Modeling the Skull–Face Overlay Uncertainty Using Fuzzy Sets , 2011, IEEE Transactions on Fuzzy Systems.

[75]  Oscar Cordón,et al.  Craniofacial Superimposition in Forensic Identification using Genetic Algorithms , 2007 .

[76]  D. Ubelaker A History of Smithsonian-FBI Collaboration in Forensic Anthropology, Especially in Regard to Facial Imagery , 2000 .

[77]  C. H. Paik,et al.  Precision, repeatability, and validation of the localization of cranial landmarks using computed tomography scans. , 1995, The Cleft palate-craniofacial journal : official publication of the American Cleft Palate-Craniofacial Association.

[78]  Robert B. Pickering,et al.  The Use of Forensic Anthropology , 2009 .

[79]  A. K. Lehrbuch der Ánthropologie in Systematischer Darstellung Mit besonderer Berücksichtigung der anthropologischen Methoden für studierende Aerzte und Forschungsreisende , 1915, Nature.

[80]  Remo Sala,et al.  A new computer-assisted technique to aid personal identification , 2009, International Journal of Legal Medicine.

[81]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[82]  Ann H. Ross Use of Digital Imaging in the Identification of Fragmentary Human Skeletal Remains: A Case from the Republic of Panama , 2004 .

[83]  G. Moreno-Rueda,et al.  Age Estimation by a Dental Method: A Comparison of Lamendin’s and Prince & Ubelaker’s Technique , 2007, Journal of forensic sciences.

[84]  Francesca De Crescenzio,et al.  3D restitution, restoration and prototyping of a medieval damaged skull , 2008 .

[85]  Caroline Wilkinson 13th Meeting of International Association of Craniofacial Identification (IACI) , 2009 .

[86]  Karen Ramey Burns,et al.  Forensic Anthropology Training Manual , 2006 .

[87]  G. Webster,et al.  Photography as an Aid in Identification: The Plumbago Pit Case , 1955 .

[88]  Cristina Cattaneo,et al.  Forensic anthropology: developments of a classical discipline in the new millennium. , 2007, Forensic science international.

[89]  Oscar Cordón,et al.  Tackling the coplanarity problem in 3D camera calibration by means of fuzzy landmarks: a performance study in forensic craniofacial superimposition , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[90]  P Vanezi,et al.  Facial reconstruction using 3-D computer graphics. , 2000, Forensic science international.

[91]  A K Ghosh,et al.  An economised craniofacial identification system. , 2001, Forensic science international.

[92]  S Miyasaka,et al.  Computer-assisted skull identification system using video superimposition. , 1997, Forensic science international.

[93]  A K Ghosh,et al.  An unusual case of cranial image recognition. , 2005, Forensic science international.

[94]  P. Vanezis,et al.  Techniques in facial identification: Computer-aided facial reconstruction using a laser scanner and video superimposition , 2005, International Journal of Legal Medicine.

[95]  Rafael Martí,et al.  Scatter Search: Diseño Básico y Estrategias avanzadas , 2002, Inteligencia Artif..

[96]  Y Lan Development and Current Status of Skull-Image Superimposition - Methodology and Instrumentation. , 1992, Forensic science review.

[97]  P. Sinha A symmetry perceiving adaptive neural network and facial image recognition. , 1998, Forensic science international.

[98]  Paul Suetens,et al.  Craniofacial reconstruction using a combined statistical model of face shape and soft tissue depths: methodology and validation. , 2006, Forensic science international.

[99]  T. Fenton,et al.  Skull‐Photo Superimposition and Border Deaths: Identification Through Exclusion and the Failure to Exclude * , 2008, Journal of forensic sciences.

[100]  Rama Chellappa,et al.  Face Processing: Advanced Modeling and Methods , 2006, J. Electronic Imaging.

[101]  Oscar Cordón,et al.  Evolutionary Approaches for Automatic 3D Modeling of Skulls in Forensic Identification , 2009, EvoWorkshops.

[102]  Patrick A. Fitzhorn,et al.  A methodology for near-optimal computational superimposition of two-dimensional digital facial photographs and three-dimensional cranial surface meshes. , 1991, Journal of forensic sciences.