Crime Detection and Criminal Recognition to Intervene in Interpersonal Violence Using Deep Convolutional Neural Network With Transfer Learning

Interpersonal violence, such as physical and sexual abuse, eve-teasing, bullying, and taking hostages, is a growing concern in our society. The criminals who directly or indirectly committed the crime often do not go into the trial for the lack of proper evidence as it is very tough to collect photographic proof of the incident. A subject’s corneal reflection has the potentiality to reveal the bystander images. Motivated with this clue, a novel approach is proposed in the current paper that uses a convolutional neural network (CNN) along with transfer learning in identifying crime as well as recognizing the criminals from the corneal reflected image of the victim called the Purkinje image. This study found that off-the-shelf CNN can be fine-tuned to extract discriminative features from very low resolution and noisy images. The procedure is validated using the developed datasets comprising six different subjects taken at diverse situations. They confirmed that it has the ability to recognize criminals from corneal reflection images with an accuracy of 95.41%. KeyWoRDS Criminal Identification, Deep Convolutional Neural Network, Interpersonal Violence, Purkinje Image

[1]  Xiaogang Wang,et al.  Deep Convolutional Network Cascade for Facial Point Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Tieniu Tan,et al.  A Light CNN for Deep Face Representation With Noisy Labels , 2015, IEEE Transactions on Information Forensics and Security.

[3]  Qi Zou,et al.  Effects of Image Degradation and Degradation Removal to CNN-Based Image Classification , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Trevor Darrell,et al.  PANDA: Pose Aligned Networks for Deep Attribute Modeling , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Nilanjan Dey,et al.  A Beginner's Guide to Data Agglomeration and Intelligent Sensing , 2020 .

[6]  Nilanjan Dey,et al.  Lightweight sustainable intelligent load forecasting platform for smart grid applications , 2020, Sustain. Comput. Informatics Syst..

[7]  Atsushi Nakazawa,et al.  Point of gaze estimation using corneal surface reflection and omnidirectional camera image , 2017, 2017 Fifteenth IAPR International Conference on Machine Vision Applications (MVA).

[8]  Ling-Yu Duan,et al.  Reflection Scene Separation From a Single Image , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Hedieh Sajedi,et al.  Improvements of Image-Steganalysis Using Boosted Combinatorial Classifiers and Gaussian High Pass Filtering , 2008, 2008 International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[10]  Yingna Li,et al.  A Visual Detection Method for Foreign Objects in Power Lines Based on Mask R-CNN , 2020, Int. J. Ambient Comput. Intell..

[11]  Lina J. Karam,et al.  Understanding how image quality affects deep neural networks , 2016, 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX).

[12]  Gitanjali Saluja,et al.  Cross-national consistency in the relationship between bullying behaviors and psychosocial adjustment. , 2004, Archives of pediatrics & adolescent medicine.

[13]  Mohammad Teshnehlab,et al.  Face Recognition Using Convolutional Neural Network and Simple Logistic Classifier , 2014 .

[14]  Li Xinhua,et al.  Face Recognition based on Deep Neural Network , 2015 .

[15]  Atsushi Nakazawa,et al.  I See What You See: Point of Gaze Estimation from Corneal Images , 2013, 2013 2nd IAPR Asian Conference on Pattern Recognition.

[16]  Christophe Garcia,et al.  A neural architecture for fast and robust face detection , 2002, Object recognition supported by user interaction for service robots.

[17]  Sebastian Thrun,et al.  Is Learning The n-th Thing Any Easier Than Learning The First? , 1995, NIPS.

[18]  Huaizu Jiang,et al.  Face Detection with the Faster R-CNN , 2016, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[19]  Changying Li,et al.  Convolutional Neural Networks for Image-Based High-Throughput Plant Phenotyping: A Review , 2020, Plant phenomics.

[20]  Patrick J. Flynn,et al.  Image understanding for iris biometrics: A survey , 2008, Comput. Vis. Image Underst..

[21]  Rob Jenkins,et al.  Identifiable Images of Bystanders Extracted from Corneal Reflections , 2013, PloS one.

[22]  Atsushi Nakazawa,et al.  Registration of eye reflection and scene images using an aspherical eye model. , 2016, Journal of the Optical Society of America. A, Optics, image science, and vision.

[23]  Bo Zhou,et al.  Long-distance tiny face detection based on enhanced YOLOv3 for unmanned system , 2020, ArXiv.

[24]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[25]  Pawan Sinha,et al.  Role of color in face recognition , 2010 .

[26]  E. Costello,et al.  Adult psychiatric outcomes of bullying and being bullied by peers in childhood and adolescence. , 2013, JAMA psychiatry.

[27]  Amartya Mukherjee,et al.  Advanced processing techniques and secure architecture for sensor networks in ubiquitous healthcare systems , 2019, Sensors for Health Monitoring.

[28]  Jose Sigut,et al.  Iris Center Corneal Reflection Method for Gaze Tracking Using Visible Light , 2011, IEEE Transactions on Biomedical Engineering.

[29]  Bogdan Kwolek,et al.  Face Detection Using Convolutional Neural Networks and Gabor Filters , 2005, ICANN.

[30]  Hao Zhou,et al.  Faster R-CNN for marine organisms detection and recognition using data augmentation , 2019, Neurocomputing.

[31]  G. M. Khaire.  Resolution Enhancement of images with Interpolation and DWT-SWT Wavelet Domain Components , 2013 .

[32]  Patrik Kamencay,et al.  A new method for face recognition using convolutional neural network , 2017 .

[33]  Radoslaw Weychan,et al.  Face Recognition from Low Resolution Images , 2012, MCSS.

[34]  Peter Corcoran,et al.  A Review and Analysis of Eye-Gaze Estimation Systems, Algorithms and Performance Evaluation Methods in Consumer Platforms , 2017, IEEE Access.

[35]  V. Bruce,et al.  Face Recognition in Poor-Quality Video: Evidence From Security Surveillance , 1999 .

[36]  Yann LeCun,et al.  Synergistic Face Detection and Pose Estimation with Energy-Based Models , 2004, J. Mach. Learn. Res..

[37]  Răzvan-Daniel Albu,et al.  Human Face Recognition Using Convolutional Neural Networks , 2009 .

[38]  Mohammad Shorif Uddin,et al.  Gaussian noise reduction in digital images using a modified fuzzy filter , 2014, 2014 17th International Conference on Computer and Information Technology (ICCIT).

[39]  Asifullah Khan,et al.  A survey of the recent architectures of deep convolutional neural networks , 2019, Artificial Intelligence Review.

[40]  Atsushi Nakazawa,et al.  Super-Resolution from Corneal Images , 2012, BMVC.

[41]  Shree K. Nayar,et al.  Corneal Imaging System: Environment from Eyes , 2006, International Journal of Computer Vision.

[42]  Atsushi Nakazawa,et al.  Point of Gaze Estimation through Corneal Surface Reflection in an Active Illumination Environment , 2012, ECCV.