Effective detection of exposed target regions based on deep learning from multimedia data

With the development of high-performance visual sensors, it has been very easy to obtain a variety of image data. Of these image data, human face regions contain personal information to distinguish one from the others. Therefore, it is important to accurately detect unhidden face regions from an input image. This paper proposes a method of robustly detecting human face regions from an input color image with the use of a deep learning algorithm, one of the machine learning algorithms. The proposed method first transforms the RGB color model of an input image to the YC b C r color model, and then removes other regions than face regions to segment skin regions with the use of the pre-learned elliptical skin color distribution model. Subsequently, a CNN model-based deep learning algorithm was applied to robustly detect human face regions from the detected skin regions in the previous step. As a result, the proposed method segments face regions more efficiently than an existing method. The face region detection method proposed in this paper is expected to be usefully applied to practical areas related to multimedia data processing, such as video surveillance, target blocking, image security, visual data analysis, and object recognition and tracking.

[1]  Min-Chun Hu,et al.  Learning and Recognition of On-Premise Signs From Weakly Labeled Street View Images , 2014, IEEE Transactions on Image Processing.

[2]  Zhengyou Zhang,et al.  Improving multiview face detection with multi-task deep convolutional neural networks , 2014, IEEE Winter Conference on Applications of Computer Vision.

[3]  Kim-Kwang Raymond Choo,et al.  Multimedia big data computing and Internet of Things applications: A taxonomy and process model , 2018, J. Netw. Comput. Appl..

[4]  Cheng Shi,et al.  Multi-scale hierarchical recurrent neural networks for hyperspectral image classification , 2018, Neurocomputing.

[5]  Stefan Katzenbeisser,et al.  Depreciating Motivation and Empirical Security Analysis of Chaos-Based Image and Video Encryption , 2018, IEEE Transactions on Information Forensics and Security.

[6]  Yunming Ye,et al.  Learning Discriminative Subspace Models for Weakly Supervised Face Detection , 2017, IEEE Transactions on Industrial Informatics.

[7]  Sunil Kumar,et al.  Combining image and global pixel distribution model for skin colour segmentation , 2017, Pattern Recognit. Lett..

[8]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Ion Bica,et al.  A security authorization scheme for smart home Internet of Things devices , 2017, Future Gener. Comput. Syst..

[10]  Edward Jones,et al.  Automatic crop detection under field conditions using the HSV colour space and morphological operations , 2017, Comput. Electron. Agric..

[11]  Kyoung-Mi Lee.  Component-based face detection and verification , 2008, Pattern Recognit. Lett..

[12]  Hongxun Yao,et al.  Hierarchical semantic image matching using CNN feature pyramid , 2018, Comput. Vis. Image Underst..

[13]  Carmelo J. A. Bastos Filho,et al.  Inter-domain routing for communication networks using Hierarchical Hopfield Neural Networks , 2018, Eng. Appl. Artif. Intell..

[14]  Jeffrey L. Andrews,et al.  Addressing overfitting and underfitting in Gaussian model-based clustering , 2018, Comput. Stat. Data Anal..

[15]  Francisco Herrera,et al.  Evaluating the classifier behavior with noisy data considering performance and robustness: The Equalized Loss of Accuracy measure , 2016, Neurocomputing.

[16]  Meng Li,et al.  A Formal Machine–Learning Approach to Generating Human–Machine Interfaces From Task Models , 2017, IEEE Transactions on Human-Machine Systems.

[17]  Shahrel Azmin Suandi,et al.  Hybrid Human Skin Detection Using Neural Network and K-Means Clustering Technique , 2015, Appl. Soft Comput..

[18]  HerreraFrancisco,et al.  Evaluating the classifier behavior with noisy data considering performance and robustness , 2016 .

[19]  Zeshui Xu,et al.  Asymmetric hesitant fuzzy sigmoid preference relations in the analytic hierarchy process , 2016, Inf. Sci..

[20]  Vikram Kapila,et al.  Toward Mobile Mixed-Reality Interaction With Multi-Robot Systems , 2017, IEEE Robotics and Automation Letters.

[21]  Yudong Zhang,et al.  Multiple sclerosis identification by convolutional neural network with dropout and parametric ReLU , 2018, J. Comput. Sci..

[22]  Changming Sun,et al.  A new method for linear feature and junction enhancement in 2D images based on morphological operation, oriented anisotropic Gaussian function and Hessian information , 2014, Pattern Recognit..

[23]  Bernard Zenko,et al.  A study of overfitting in optimization of a manufacturing quality control procedure , 2017, Appl. Soft Comput..

[24]  Huiru Zheng,et al.  Situation Awareness Inferred From Posture Transition and Location: Derived From Smartphone and Smart home Sensors , 2017, IEEE Transactions on Human-Machine Systems.

[25]  Zhiqiang Ge,et al.  Deep Learning of Semisupervised Process Data With Hierarchical Extreme Learning Machine and Soft Sensor Application , 2018, IEEE Transactions on Industrial Electronics.

[26]  정지년,et al.  Efficient Face Detection using Adaboost and Facial Color , 2006 .

[27]  Gang Niu,et al.  Learning an video frame-based face detection system for security fields , 2018, J. Vis. Commun. Image Represent..

[28]  Marios Savvides,et al.  Reformulating Level Sets as Deep Recurrent Neural Network Approach to Semantic Segmentation , 2017, IEEE Transactions on Image Processing.

[29]  Jian Yang,et al.  Sparseness Analysis in the Pretraining of Deep Neural Networks , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[30]  Davis E. King.  Max-Margin Object Detection , 2015, ArXiv.

[31]  Jiwen Lu,et al.  Multi-modal uniform deep learning for RGB-D person re-identification , 2017, Pattern Recognit..

[32]  Fredrik Kahl,et al.  Robust Abdominal Organ Segmentation Using Regional Convolutional Neural Networks , 2017, SCIA.

[33]  Ling Shao,et al.  Action Recognition From Arbitrary Views Using Transferable Dictionary Learning , 2018, IEEE Transactions on Image Processing.

[34]  Abderrahmane Kheddar,et al.  Interlinked Visual Tracking and Robotic Manipulation of Articulated Objects , 2018, IEEE Robotics and Automation Letters.

[35]  Xuanqin Mou,et al.  Quality Assessment of Screen Content Images via Convolutional-Neural-Network-Based Synthetic/Natural Segmentation , 2018, IEEE Transactions on Image Processing.

[36]  Paul J. Scott,et al.  Algorithms for Morphological Profile Filters and their Comparison , 2012 .

[37]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[38]  Souyah Amina,et al.  An efficient and secure chaotic cipher algorithm for image content preservation , 2018, Commun. Nonlinear Sci. Numer. Simul..

[39]  Mingyang Zhang,et al.  3-D Compression-Oriented Image Content Correlation Model for Wireless Visual Sensor Networks , 2018, IEEE Sensors Journal.