A hybrid feature selection approach based on improved PSO and filter approaches for image steganalysis

This paper proposes a novel feature selection approach to improve the classification accuracy and reduce the computational complexity in image steganalysis. It is a hybrid filter-wrapper approach based on improved Particle Swarm Optimization (PSO). It consists of two phases: the first phase is composed of two filter techniques namely t test and multiple-regression which selects the features based on their ability to discriminate images as stego or cover. The second phase further reduces the number of features by working on the significant features selected during the first phase using an improved PSO. This approach overcomes the disadvantages of global best PSO by integrating it with local best PSO and dynamically changing the population size (Hope/Rehope). The proposed approach is tested on two sets of features extracted from spatial domain (SPAM-Subtractive Adjacency Matrix) and transform domain (CCPEV-Cartesian Calibrated features extracted by Pevný) for four embedding algorithms nsF5, Outguess, Perturbed Quantization and Steghide using SVM (Support Vector Machine) classifier. Experimental results demonstrate that this approach significantly improves the classification accuracy and drastically reduces dimensionality as compared to results produced by some well-known feature selection algorithms.

[1]  Tomás Pevný,et al.  Merging Markov and DCT features for multi-class JPEG steganalysis , 2007, Electronic Imaging.

[2]  Md. Rafiqul Islam,et al.  Hybrids of support vector machine wrapper and filter based framework for malware detection , 2016, Future Gener. Comput. Syst..

[3]  Mohammad Saniee Abadeh,et al.  Image steganalysis using a bee colony based feature selection algorithm , 2014, Eng. Appl. Artif. Intell..

[4]  M. Clerc,et al.  Particle Swarm Optimization , 2006 .

[5]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[6]  Jessica J. Fridrich,et al.  Ensemble Classifiers for Steganalysis of Digital Media , 2012, IEEE Transactions on Information Forensics and Security.

[7]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[8]  Guoming Chen,et al.  Particle Swarm Optimization Feature Selection for Image Steganalysis , 2012, 2012 Fourth International Conference on Digital Home.

[9]  Li-Yeh Chuang,et al.  Improved binary particle swarm optimization using catfish effect for feature selection , 2011, Expert Syst. Appl..

[10]  Xiaoming Xu,et al.  A hybrid genetic algorithm for feature selection wrapper based on mutual information , 2007, Pattern Recognit. Lett..

[11]  B. B. Xia,et al.  Improve Steganalysis by MWM Feature Selection , 2012 .

[12]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[13]  Yonghong Peng,et al.  A novel feature selection approach for biomedical data classification , 2010, J. Biomed. Informatics.

[14]  Zahir Tari,et al.  Toward an efficient and scalable feature selection approach for internet traffic classification , 2013, Comput. Networks.

[15]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[16]  Mansour Sheikhan,et al.  Improved contourlet-based steganalysis using binary particle swarm optimization and radial basis neural networks , 2011, Neural Computing and Applications.

[17]  Liangxiao Jiang,et al.  Not so greedy: Randomly Selected Naive Bayes , 2012, Expert Syst. Appl..

[18]  K. Hess,et al.  An Empirical Study of Univariate and Genetic Algorithm-Based Feature Selection in Binary Classification with Microarray Data , 2006, Cancer informatics.

[19]  A. C. Rencher Methods of multivariate analysis , 1995 .

[20]  Mark A. Hall,et al.  Correlation-based Feature Selection for Discrete and Numeric Class Machine Learning , 1999, ICML.

[21]  Hany Farid,et al.  Detecting hidden messages using higher-order statistical models , 2002, Proceedings. International Conference on Image Processing.

[22]  Nasir D. Memon,et al.  Steganalysis using image quality metrics , 2003, IEEE Trans. Image Process..

[23]  Fenlin Liu,et al.  Selection of image features for steganalysis based on the Fisher criterion , 2014, Digit. Investig..

[24]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[25]  Tim Hendtlass A particle swarm algorithm for high dimensional, multi-optima problem spaces , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[26]  Yanqing Zhang,et al.  A genetic algorithm-based method for feature subset selection , 2008, Soft Comput..

[27]  Amaury Lendasse,et al.  A Feature Selection Methodology for Steganalysis , 2006, MRCS.

[28]  Jessica J. Fridrich,et al.  Perturbed quantization steganography , 2005, Multimedia Systems.

[29]  Shutao Li,et al.  Gene Feature Extraction Using T-Test Statistics and Kernel Partial Least Squares , 2006, ICONIP.

[30]  Kevin Curran,et al.  Digital image steganography: Survey and analysis of current methods , 2010, Signal Process..

[31]  Edward R. Dougherty,et al.  Performance of feature-selection methods in the classification of high-dimension data , 2009, Pattern Recognit..

[32]  Igor Kononenko,et al.  Estimating Attributes: Analysis and Extensions of RELIEF , 1994, ECML.

[33]  Guorong Xuan,et al.  Feature Selection based on the Bhattacharyya Distance , 2006, ICPR.

[34]  N. Kamaraj,et al.  Optimized Image Steganalysis through Feature Selection using MBEGA , 2010, ArXiv.

[35]  Tomás Pevný,et al.  Steganalysis by subtractive pixel adjacency matrix , 2010, IEEE Trans. Inf. Forensics Secur..

[36]  Ajaz Hussain Mir,et al.  Classification of steganalysis techniques: A study , 2010, Digit. Signal Process..

[37]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..