A proposed PCNN features quality optimization technique for pose-invariant 3D Arabic sign language recognition

This paper proposes a novel technique to deal with pose variations in 3D object recognition. This technique uses pulse-coupled neural network (PCNN) for image features generation from two different viewing angles. These signatures qualities are then evaluated, using a proposed fitness function. The features evaluation step is taken before any classification steps are performed. The evaluation results dynamic weighting factors for each camera express the features quality from the current viewing angles. The proposed technique uses the two 2D image features and their corresponding calculated weighting factors to construct optimized quality 3D features. An experiment was conducted in Arabic sign language recognition application which multiple views are necessary to distinguish some signs. The proposed technique obtained a 96% recognition accuracy for pose-invariant restrictions with a degree of freedom from 0 to 90.

[1]  Lance M. Optican,et al.  Temporal Codes for Colors, Patterns, and Memories , 1994 .

[2]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[3]  Bernard F. Buxton,et al.  Pose-Invariant 3D Object Recognition Using Linear Combination of 2D Views and Evolutionary Optimisation , 2007, 2007 International Conference on Computing: Theory and Applications (ICCTA'07).

[4]  Qiguang Miao,et al.  A novel adaptive multi-focus image fusion algorithm based on PCNN and sharpness , 2005, SPIE Defense + Commercial Sensing.

[5]  Chung-Lin Huang,et al.  Hand gesture recognition using a real-time tracking method and hidden Markov models , 2003, Image Vis. Comput..

[6]  Stephen Coombes,et al.  A Dynamical Theory of Spike Train Transitions in Networks of Integrate-and-Fire Oscillators , 2000, SIAM J. Appl. Math..

[7]  Jan Wieghardt,et al.  Learning the Topology of Object Views , 2002, ECCV.

[8]  Daniel Kelly,et al.  Continuous recognition of motion based gestures in sign language , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[9]  Horst M. Eidenberger.  Kalman Filtering for Pose-Invariant Face Recognition , 2006, 2006 International Conference on Image Processing.

[10]  David W. Jacobs,et al.  Space and Time Bounds on Indexing 3D Models from 2D Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  J. L. Johnson.  Pulse-coupled neural nets: translation, rotation, scale, distortion, and intensity signal invariance for images. , 1994, Applied optics.

[12]  Hermann Hienz,et al.  Relevant features for video-based continuous sign language recognition , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[13]  Xia Liu,et al.  Sign recognition using depth image streams , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[14]  Mohammad A. Al-Rousan,et al.  Automatic Recognition of Arabic Sign Language Finger Spelling , 2001, Int. J. Comput. Their Appl..

[15]  Mohamed A. Deriche,et al.  Image based arabic sign language recognition , 2005, Proceedings of the Eighth International Symposium on Signal Processing and Its Applications, 2005..

[16]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  João M. F. Rodrigues,et al.  Cortical 3D Face and Object Recognition Using 2D Projections , 2012, Int. J. Creative Interfaces Comput. Graph..

[18]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[19]  Hermann Ney,et al.  SIGNSPEAK: Scientific Understanding and Vision-based Technological Development for Continuous Sign Language Recognition and Translation , 2013, MTSUMMIT.

[20]  Bo Yu,et al.  Pulse-coupled neural networks for contour and motion matchings , 2004, IEEE Transactions on Neural Networks.

[21]  Shi Weili,et al.  Research of automatic medical image segmentation algorithm based on Tsallis entropy and improved PCNN , 2009, 2009 International Conference on Mechatronics and Automation.

[22]  Kostas Topouzelis.  A Neural Network Approach to Oil Spill Detection using SAR Data , 2003 .

[23]  T. Poggio,et al.  A network that learns to recognize three-dimensional objects , 1990, Nature.

[24]  Anuj Srivastava,et al.  Probability Models for Clutter in Natural Images , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Yehezkel Lamdan,et al.  Geometric Hashing: A General And Efficient Model-based Recognition Scheme , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[26]  Zhang Yi,et al.  A modified pulse coupled neural network for shortest-path problem , 2009, Neurocomputing.

[27]  Lucas Paletta,et al.  Appearance-based active object recognition , 2000, Image Vis. Comput..

[28]  Gerhard Rigoll,et al.  Hidden Markov model based continuous online gesture recognition , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[29]  Keisuke Takada,et al.  3D Object recognition using a voting algorithm in a real-world environment , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[30]  Omar M. Al-Jarrah,et al.  Recognition of gestures in Arabic sign language using neuro-fuzzy systems , 2001, Artif. Intell..

[31]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Hermann Ney,et al.  Signspeak--understanding, recognition, and translation of sign languages , 2010 .

[33]  Peter Vamplew.  Recognition of sign language gestures using neural networks , 1996 .

[34]  Shingo Mabu,et al.  Image denoising using pulse coupled neural network with an adaptive Pareto genetic algorithm , 2011 .

[35]  Raul Cristian Muresan,et al.  Pattern recognition using pulse-coupled neural networks and discrete Fourier transforms , 2003, Neurocomputing.

[36]  I. Mokris,et al.  Feature generation improving by optimized PCNN , 2008, 2008 6th International Symposium on Applied Machine Intelligence and Informatics.

[37]  Liu Qing,et al.  Automated image segmentation using improved PCNN model based on cross-entropy , 2004, Proceedings of 2004 International Symposium on Intelligent Multimedia, Video and Speech Processing, 2004..

[38]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[39]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[40]  H H Bülthoff,et al.  Psychophysical support for a two-dimensional view interpolation theory of object recognition. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[41]  Fang Gao.  A Signer-Independent Sign Language Recognition System Based on SOFM/HMM , 2002 .

[42]  Shimon Ullman,et al.  Recognizing solid objects by alignment with an image , 1990, International Journal of Computer Vision.

[43]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[44]  Yide Ma,et al.  Applications of Pulse-Coupled Neural Networks , 2011 .

[45]  Ahmed Samir,et al.  Arabic sign language recognition using neural network and graph matching techniques , 2006 .

[46]  Khaled Assaleh,et al.  Recognition of Arabic Sign Language Alphabet Using Polynomial Classifiers , 2005, EURASIP J. Adv. Signal Process..

[47]  Silvio Savarese,et al.  Depth-Encoded Hough Voting for Joint Object Detection and Shape Recovery , 2010, ECCV.

[48]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[49]  Ruigang Yang,et al.  Spatial-Depth Super Resolution for Range Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[50]  Jeffery Johnson,et al.  Pulse coupled neural networks for image processing , 1995, Proceedings IEEE Southeastcon '95. Visualize the Future.

[51]  Karl-Friedrich Kraiss,et al.  Robust Person-Independent Visual Sign Language Recognition , 2005, IbPRIA.