Rotated Sphere Haar Wavelet and Deep Contractive Auto-Encoder Network With Fuzzy Gaussian SVM for Pilot’s Pupil Center Detection

How to track the attention of the pilot is a huge challenge. We are able to capture the pupil status of the pilot and analyze their anomalies and judge the attention of the pilot. This paper proposes a new approach to solve this problem through the integration of spherical Haar wavelet transform and deep learning methods. First, considering the application limitations of Haar wavelet and other wavelets in spherical signal decomposition and reconstruction, a feature learning method based on the spherical Haar wavelet is proposed. In order to obtain the salient features of the spherical signal, a rotating spherical Haar wavelet is also proposed, which has a consistent scale in the same direction between the reconstructed image and the original image. Second, in order to find a better characteristic representation of the spherical signal, a higher contractive autoencoder (HCAE) is designed for the potential representation of the spherical Haar wavelet coefficients, which has two penalty items, respectively, from Jacobian and two order items from Taylor expansion of the point ${x}$ for the contract learning of sample space. Third, in order to improve the classification performance, this paper proposes a fuzzy Gaussian support vector machine (FGSVM) as the top classification tool of the deep learning model, which can punish some Gaussian noise from the output of the deep HCAE network (DHCAEN). Finally, a DHCAEN-FGSVM classifier is proposed to identify the location of the pupil center. The experimental results of the public data set and actual data show that our model is an effective method for spherical signal detection.

[1]  A. Evans,et al.  MRI simulation-based evaluation of image-processing and classification methods , 1999, IEEE Transactions on Medical Imaging.

[2]  Gregory M. Nielson,et al.  Haar wavelets over triangular domains with applications to multiresolution models for flow over a sphere , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[3]  Pat Hanrahan,et al.  All-frequency shadows using non-linear wavelet lighting approximation , 2003, ACM Trans. Graph..

[4]  Shuang Wang,et al.  Fuzzy Sparse Autoencoder Framework for Single Image Per Person Face Recognition , 2018, IEEE Transactions on Cybernetics.

[5]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[6]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[7]  Worthy N. Martin,et al.  Human-computer interaction using eye-gaze input , 1989, IEEE Trans. Syst. Man Cybern..

[8]  Wan-Chun Ma,et al.  Real-time triple product relighting using spherical local-frame parameterization , 2006, The Visual Computer.

[9]  Ling Shao,et al.  Deep Nonlinear Metric Learning for 3-D Shape Retrieval , 2018, IEEE Transactions on Cybernetics.

[10]  Willi Freeden,et al.  Combined Spherical Harmonic and Wavelet Expansion—A Future Concept in Earth's Gravitational Determination , 1997 .

[11]  Jinxing Lin,et al.  Pilots’ Fatigue Status Recognition Using Deep Contractive Autoencoder Network , 2019, IEEE Transactions on Instrumentation and Measurement.

[12]  Tomaso A. Poggio,et al.  A general framework for object detection , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[13]  Xin Jin,et al.  Wavelet-based feature extraction using probabilistic finite state automata for pattern classification , 2011, Pattern Recognit..

[14]  Kay Chen Tan,et al.  Multiobjective Deep Belief Networks Ensemble for Remaining Useful Life Estimation in Prognostics , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Federico Girosi,et al.  Training support vector machines: an application to face detection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Alan C. Evans,et al.  An Extensible MRI Simulator for Post-Processing Evaluation , 1996, VBC.

[17]  Jun Yu,et al.  Coupled Deep Autoencoder for Single Image Super-Resolution , 2017, IEEE Transactions on Cybernetics.

[18]  Shiguang Shan,et al.  Strip Features for Fast Object Detection , 2013, IEEE Transactions on Cybernetics.

[19]  Dong Ming,et al.  Infrared gait recognition based on wavelet transform and support vector machine , 2010, Pattern Recognit..

[20]  M.T. Rahman,et al.  Face recognition using Gabor Filters , 2008, 2008 11th International Conference on Computer and Information Technology.

[21]  S. Sengupta,et al.  Nonlinear principal component analysis of climate data , 1995 .

[22]  Junwei Han,et al.  A Unified Metric Learning-Based Framework for Co-Saliency Detection , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Lei Guo,et al.  When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Hong Qin,et al.  Brain Image Analysis Using Spherical Splines , 2005, EMMCVPR.

[25]  W. Sweldens,et al.  A new class of unbalanced haar wavelets that form an unconditional basis for Lp on general measure spaces , 1997 .

[26]  Boon-Lock Yeo,et al.  Volume Rendering of DCT-Based Compressed 3D Scalar Data , 1995, IEEE Trans. Vis. Comput. Graph..

[27]  Alan C. Evans,et al.  BrainWeb: Online Interface to a 3D MRI Simulated Brain Database , 1997 .

[28]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[29]  Moshe Eizenman,et al.  A naturalistic visual scanning approach to assess selective attention in major depressive disorder , 2003, Psychiatry Research.

[30]  Xiaoqing Feng,et al.  Multimodal video classification with stacked contractive autoencoders , 2016, Signal Process..

[31]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[32]  Junwei Han,et al.  Duplex Metric Learning for Image Set Classification , 2018, IEEE Transactions on Image Processing.

[33]  Samuel R. Buss,et al.  Spherical averages and applications to spherical splines and interpolation , 2001, TOGS.

[34]  Hongming Zhou,et al.  Stacked Extreme Learning Machines , 2015, IEEE Transactions on Cybernetics.

[35]  Hong Hua,et al.  A fast connected components labeling algorithm and its application to real-time pupil detection , 2009, Machine Vision and Applications.

[36]  Anastasios Tefas,et al.  Using Support Vector Machines to Enhance the Performance of Elastic Graph Matching for Frontal Face Authentication , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Yillbyung Lee,et al.  Iris Recognition System Using Wavelet Packet and Support Vector Machines , 2003, WISA.

[38]  David F Neri,et al.  Fatigue countermeasures in aviation. , 2009, Aviation, space, and environmental medicine.

[39]  B. T. Thomas Yeo,et al.  Invertible Filter Banks on the 2-Sphere , 2006, 2006 International Conference on Image Processing.

[40]  Paul A. Wetzel,et al.  An Eye Tracking System for Analysis of Pilots' Scan Paths. , 1997 .

[41]  Xiaojin Zhu,et al.  Semi-Supervised Learning , 2010, Encyclopedia of Machine Learning.

[42]  Moshe Eizenman,et al.  General theory of remote gaze estimation using the pupil center and corneal reflections , 2006, IEEE Transactions on Biomedical Engineering.

[43]  D. Louis Collins,et al.  Design and construction of a realistic digital brain phantom , 1998, IEEE Transactions on Medical Imaging.

[44]  Ronald A. DeVore,et al.  Image compression through wavelet transform coding , 1992, IEEE Trans. Inf. Theory.

[45]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[46]  Peter-Pike J. Sloan,et al.  Clustered principal components for precomputed radiance transfer , 2003, ACM Trans. Graph..

[47]  Jorge Stolfi,et al.  Bases for Non-homogeneous Polynomial Ck Splines on the Sphere , 1998, LATIN.

[48]  W. Dahmen,et al.  Multiresolution analysis and wavelets on S2 and S3 , 1995 .

[49]  A. Baddeley,et al.  Attention : selection, awareness, and control : a tribute to Donald Broadbent , 1996 .

[50]  Georges-Pierre Bonneau Optimal triangular Haar bases for spherical data , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[51]  Thomas Serre,et al.  Hierarchical classification and feature reduction for fast face detection with support vector machines , 2003, Pattern Recognit..

[52]  L. M. M.-T. Spherical Harmonics: an Elementary Treatise on Harmonic Functions, with Applications , 1928, Nature.

[53]  Yuan Yao,et al.  Fingerprint Classification with Combinations of Support Vector Machines , 2001, AVBPA.

[54]  Gwen Littlewort,et al.  Real Time Face Detection and Facial Expression Recognition: Development and Applications to Human Computer Interaction. , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[55]  Peter Schröder,et al.  Spherical wavelets: efficiently representing functions on the sphere , 1995, SIGGRAPH.

[56]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.