Detecting Seam-Carved Image by Extreme Learning Machines Using Patch Analysis Method, Jury Voting, and Combinatorial Fusion

Seam carving is a content-aware image processing approach that has been successfully applied to resizing or removing objects from digital images. Seam-carved images are hard to identify from the original image, making this detection method an important and attractive research topic. Existing methods are based on steganography attacks or statistical features, and their trained and tested models are all constructed using support vector machines (SVMs). The trained models of these methods take a long time to build from a limited number of images. This paper presents a new patch-based sobel operator (PSO) method using SVM and extreme learning machines (ELMs) based on the patch analysis method with square-based features. The ELM adopts five types of neurons to obtain five prediction results, which are then combined using the jury voting scheme in order to improve the accuracy. In addition, combinatorial fusion is first used to choose two of five prediction results according to the diversity rank/score graph, and these two results are then combined to make the final decision. The PSO method in the ELM with jury voting and combinatorial fusion achieves accuracies of 70.60–98.80% and 95.58–99.36% for 10–50% seam-carved and seam-insertion images, respectively. Additionally, for the PSO method, the ELM required only 1.2% of the training time required by the SVM. In conclusion, the PSO method in the ELM is useful for constructing trained models from a large number of images.

[1]  Xingming Sun,et al.  Detecting seam carving based image resizing using local binary patterns , 2015, Comput. Secur..

[2]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[3]  Ramesh Raskar,et al.  Automatic image retargeting , 2005, MUM '05.

[4]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Yu-Ju Lin,et al.  A patch analysis method to detect seam carved images , 2014, Pattern Recognit. Lett..

[6]  Stuart M. Brown,et al.  Selection and validation of differentially expressed genes in head and neck cancer , 2004, Cellular and Molecular Life Sciences CMLS.

[7]  Olga Sorkine-Hornung,et al.  A comparative study of image retargeting , 2010, ACM Trans. Graph..

[8]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[9]  Wei Jia,et al.  Histogram of Oriented Lines for Palmprint Recognition , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[10]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[11]  Hongming Zhou,et al.  Optimization method based extreme learning machine for classification , 2010, Neurocomputing.

[12]  Min Wu,et al.  Seam carving estimation using forensic hash , 2011, MM&Sec '11.

[13]  Weidong Min,et al.  Detection of Seam Carved Image Based on Additional Seam Carving Behavior , 2016 .

[14]  Changjun Jiang,et al.  Satellite Objects Extraction and Classification Based on Similarity Measure , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[15]  Xing Xie,et al.  A visual attention model for adapting images on small displays , 2003, Multimedia Systems.

[16]  Chih-Jen Lin,et al.  Fine‐grained protein fold assignment by support vector machines using generalized npeptide coding schemes and jury voting from multiple‐parameter sets , 2003, Proteins.

[17]  Gaurav Sharma,et al.  Detecting content adaptive scaling of images for forensic applications , 2010, Electronic Imaging.

[18]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[19]  Garrison W. Cottrell,et al.  Fusion Via a Linear Combination of Scores , 1999, Information Retrieval.

[20]  D. Frank Hsu,et al.  Comparing Rank and Score Combination Methods for Data Fusion in Information Retrieval , 2005, Information Retrieval.

[21]  Daniel Cohen-Or,et al.  Non-homogeneous Content-driven Video-retargeting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[22]  Chuanhou Gao,et al.  A comparative analysis of support vector machines and extreme learning machines , 2012, Neural Networks.

[23]  D. Frank Hsu,et al.  Consensus Scoring Criteria for Improving Enrichment in Virtual Screening , 2005, J. Chem. Inf. Model..

[24]  H.M. Wechsler,et al.  Digital image processing, 2nd ed. , 1981, Proceedings of the IEEE.

[25]  Yun Q. Shi,et al.  A Markov Process Based Approach to Effective Attacking JPEG Steganography , 2006, Information Hiding.

[26]  Weiming Dong,et al.  Optimized image resizing using seam carving and scaling , 2009, SIGGRAPH 2009.

[27]  Jhing-Fa Wang,et al.  Smart Homecare Surveillance System: Behavior Identification Based on State-Transition Support Vector Machines and Sound Directivity Pattern Analysis , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[28]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[29]  S. Avidan,et al.  Seam carving for content-aware image resizing , 2007, SIGGRAPH 2007.

[30]  Xingming Sun,et al.  Detecting image seam carving with low scaling ratio using multi-scale spatial and spectral entropies , 2017, J. Vis. Commun. Image Represent..

[31]  Jing Guo,et al.  Exploring the location of object deleted by seam-carving , 2018, Expert Syst. Appl..

[32]  Anindya Sarkar,et al.  Detection of seam carving and localization of seam insertions in digital images , 2009, MM&Sec '09.

[33]  Paul Wintz,et al.  Digital image processing (2nd ed.) , 1987 .

[34]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[35]  Chuan Yi Tang,et al.  Feature Selection and Combination Criteria for Improving Accuracy in Protein Structure Prediction , 2007, IEEE Transactions on NanoBioscience.

[36]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[37]  Michael Gleicher,et al.  Automatic image retargeting with fisheye-view warping , 2005, UIST.

[38]  Gerald Schaefer,et al.  UCID: an uncompressed color image database , 2003, IS&T/SPIE Electronic Imaging.

[39]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, ACM Trans. Graph..

[40]  Alexander Wong,et al.  Enhanced Seam Carving via Integration of Energy Gradient Functionals , 2011, IEEE Signal Processing Letters.

[41]  Jacek M. Zurada,et al.  Review and performance comparison of SVM- and ELM-based classifiers , 2014, Neurocomputing.

[42]  Chin-Teng Lin,et al.  An Improved Polynomial Neural Network Classifier Using Real-Coded Genetic Algorithm , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[43]  H. Farid Image Forgery Detection -- A survey , 2009 .