Accurate Pixel-Wise Skin Segmentation Using Shallow Fully Convolutional Neural Network

Skin segmentation plays an important role in human activity recognition, video surveillance, hand gesture identification, face detection, human tracking and robotic surgery. The accurate segmentation of the skin is necessary to recognize the human activity. Segmentation of skin is easy to realize in ideal situations because of similar backgrounds. But it becomes complicated because of presence of skin-like pixels, background illuminations, and certain changes in environment. These problems are addressed by incorporating preprocessing stages in current studies, but this raises the total cost of the system. However, there are some limitations associated with these methods in terms of accuracy and processing speed. In this work, we propose a skin semantic segmentation network (SSS-Net) that is able to capture the multi-scale contextual information and refines the segmentation results especially along object boundaries. Moreover our network helps to reduce the cost of the preprocessing as well. We have performed experiments on the five open datasets of human activity recognition for the segmentation of skin. Experimental results show SSS-Net outperforms the state-of-the-art methods in skin segmentation in terms of accuracies.

[1]  Kuldeep Singh,et al.  Convolutional neural networks for crowd behaviour analysis: a survey , 2019, The Visual Computer.

[2]  B. B. Zaidan,et al.  Image skin segmentation based on multi-agent learning Bayesian and neural network , 2014, Eng. Appl. Artif. Intell..

[3]  Abdolhossein Sarrafzadeh,et al.  An adaptive real-time skin detector based on Hue thresholding: A comparison on two motion tracking methods , 2006, Pattern Recognit. Lett..

[4]  Yi He,et al.  Semi-Supervised Skin Detection by Network With Mutual Guidance , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[5]  Loris Nanni,et al.  Learning morphological operators for skin detection , 2019, ArXiv.

[6]  Mohd Aizaini Maarof,et al.  Improved skin detection based on dynamic threshold using multi-colour space , 2014, 2014 International Symposium on Biometrics and Security Technologies (ISBAST).

[7]  Otman A. Basir,et al.  Using ga to optimize the explicitly defined skin regions for human skincolor detection , 2017, 2017 IEEE 30th Canadian Conference on Electrical and Computer Engineering (CCECE).

[8]  Yiqing Zhang,et al.  Mask-Refined R-CNN: A Network for Refining Object Details in Instance Segmentation , 2020, Sensors.

[10]  Fumeng Gao,et al.  Mobile Palmprint Segmentation Based on Improved Active Shape Model , 2018, J. Multim. Inf. Syst..

[11]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[12]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[13]  Muhammad Khurram Khan,et al.  Logical Conjunction of Triple-Perpendicular-Directional Translation Residual for Contactless Palmprint Preprocessing , 2014, 2014 11th International Conference on Information Technology: New Generations.

[14]  Weigang Li,et al.  Domain Adaptation for Holistic Skin Detection , 2019, 2021 34th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI).

[15]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Ming Li,et al.  Dual-source discrimination power analysis for multi-instance contactless palmprint recognition , 2015, Multimedia Tools and Applications.

[17]  Lei Huang,et al.  Robust skin detection in real-world images , 2015, J. Vis. Commun. Image Represent..

[18]  Richard Kronland-Martinet,et al.  A real-time algorithm for signal analysis with the help of the wavelet transform , 1989 .

[19]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  S. Mohamed Mansoor Roomi,et al.  Hand Gesture Recognition for Human-Computer Interaction , 2010 .

[21]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Lu Leng,et al.  Non-contact Palmprint Attendance System on PC Platform , 2018 .

[23]  Yuning Jiang,et al.  Randomized spatial pooling in deep convolutional networks for scene recognition , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[24]  Iasonas Kokkinos,et al.  Modeling local and global deformations in Deep Learning: Epitomic convolution, Multiple Instance Learning, and sliding window detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Muhammad Khurram Khan,et al.  Dynamic weighted discrimination power analysis: A novel approach for face and palmprint recognition in DCT domain , 2010 .

[26]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 2004, International Journal of Computer Vision.

[27]  Sunil Kumar,et al.  A Weighted Skin Probability Map for skin color segmentation , 2016, 2016 International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET).

[28]  Emir Buza,et al.  Skin detection based on image color segmentation with histogram and K-means clustering , 2017, 2017 10th International Conference on Electrical and Electronics Engineering (ELECO).

[29]  Jenq-Neng Hwang,et al.  A Review on Video-Based Human Activity Recognition , 2013, Comput..

[30]  Allan Hanbury,et al.  Skin detection: A random forest approach , 2010, 2010 IEEE International Conference on Image Processing.

[31]  Shahrel Azmin Suandi,et al.  Hybrid Human Skin Detection Using Neural Network and K-Means Clustering Technique , 2015, Appl. Soft Comput..

[32]  Alan F. Smeaton,et al.  Detector adaptation by maximising agreement between independent data sources , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  R. Sreemathy,et al.  Vision based hand gesture recognition using eccentric approach for human computer interaction , 2014, 2014 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[34]  Kin-Man Lam,et al.  A novel approach for human face detection from color images under complex background , 2001, Pattern Recognition.

[35]  Luca Maria Gambardella,et al.  Fast image scanning with deep max-pooling convolutional neural networks , 2013, 2013 IEEE International Conference on Image Processing.

[36]  Opim Salim Sitompul,et al.  Skin color segmentation using multi-color space threshold , 2016, 2016 3rd International Conference on Computer and Information Sciences (ICCOINS).

[37]  Kang Ryoung Park,et al.  OR-Skip-Net: Outer residual skip network for skin segmentation in non-ideal situations , 2020, Expert Syst. Appl..

[38]  Juan C. SanMiguel,et al.  Skin detection by dual maximization of detectors agreement for video monitoring , 2013, Pattern Recognit. Lett..

[39]  Iasonas Kokkinos,et al.  Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs , 2014, ICLR.

[40]  P. Ganesan,et al.  International Conference on Recent Trends in Computing 2015 ( ICRTC-2015 ) Comparative Study of Skin Color Detection and Segmentation in HSV and YCbCr Color Space , 2015 .

[41]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[42]  Rajiv Ranjan Sahay,et al.  Deep Learning Based Hand Detection in Cluttered Environment Using Skin Segmentation , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[43]  Nam Ik Cho,et al.  A New Convolutional Network-in-Network Structure and Its Applications in Skin Detection, Semantic Segmentation, and Artifact Reduction , 2017, ArXiv.

[44]  Jun Chu,et al.  Object Detection Based on Multi-Layer Convolution Feature Fusion and Online Hard Example Mining , 2018, IEEE Access.

[45]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[46]  Che-Yu Chang,et al.  An improved skin color model , 2016, 2016 International Conference on Applied System Innovation (ICASI).