A Nonlinear Regression Application via Machine Learning Techniques for Geomagnetic Data Reconstruction Processing

The integrity of geomagnetic data is a critical factor in understanding the evolutionary process of Earth’s magnetic field, as it provides useful information for near-surface exploration, unexploded explosive ordnance detection, and so on. Aimed to reconstruct undersampled geomagnetic data, this paper presents a geomagnetic data reconstruction approach based on machine learning techniques. The traditional linear interpolation approaches are prone to time inefficiency and high labor cost, while the proposed approach has a significant improvement. In this paper, three classic machine learning models, support vector machine, random forests, and gradient boosting were built. Besides, a deep learning algorithm, recurrent neural network, was explored to further improve the training performance. The proposed learning models were used to specify a continuous regression hyperplane from a training data. The specified regression hyperplane is a mapping of the relation between the mock-up missing data and the surrounding intact data. Afterward, the trained models, essentially the hyperplanes, were used to reconstruct the missing geomagnetic traces for validation, and they can be used for reconstructing further collected new field data. Finally, numerical experiments were derived. The results showed that the performance of our methods was more competitive in comparison with the traditional linear method, as the reconstruction accuracy was increased by approximately 10%~20%.

[1]  Jürgen Schmidhuber,et al.  Learning Precise Timing with LSTM Recurrent Networks , 2003, J. Mach. Learn. Res..

[2]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[3]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[4]  Tarek Helmy,et al.  Hybrid computational models for the characterization of oil and gas reservoirs , 2010, Expert Syst. Appl..

[5]  Andrew Zisserman,et al.  Image Classification using Random Forests and Ferns , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[6]  Andrew W. Senior,et al.  Long Short-Term Memory Based Recurrent Neural Network Architectures for Large Vocabulary Speech Recognition , 2014, ArXiv.

[7]  Christoph Goller,et al.  Learning task-dependent distributed representations by backpropagation through structure , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[8]  A. Prasad,et al.  Newer Classification and Regression Tree Techniques: Bagging and Random Forests for Ecological Prediction , 2006, Ecosystems.

[9]  Jürgen Schmidhuber,et al.  Framewise phoneme classification with bidirectional LSTM and other neural network architectures , 2005, Neural Networks.

[10]  Gwen Littlewort,et al.  Recognizing facial expression: machine learning and application to spontaneous behavior , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  Lukás Burget,et al.  Recurrent neural network based language model , 2010, INTERSPEECH.

[12]  Jong-Se Lim,et al.  Reservoir properties determination using fuzzy logic and neural networks from well data in offshore Korea , 2005 .

[13]  Yuan Cao,et al.  RS-SVM forecasting model and power supply-demand forecast , 2011 .

[14]  Vincent Serneels,et al.  Reconstructing the Geomagnetic Field in West Africa: First Absolute Intensity Results from Burkina Faso , 2017, Scientific Reports.

[15]  James A. Slavin,et al.  Observations of Mercury's northern cusp region with MESSENGER's Magnetometer , 2011 .

[16]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[17]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[18]  Chuan Ding,et al.  Prioritizing Influential Factors for Freeway Incident Clearance Time Prediction Using the Gradient Boosting Decision Trees Method , 2017, IEEE Transactions on Intelligent Transportation Systems.

[19]  V. A. Sapunov,et al.  Overhauser vector magnetometer POS-4: Results of continuous measurements during 2015–2016 at geophysical observatory “Paratunka” of IKIR FEB RAS, Kamchatka, Russia , 2016 .

[20]  Olivier Chapelle,et al.  Model Selection for Support Vector Machines , 1999, NIPS.

[21]  Jianwei Ma,et al.  What can machine learning do for seismic data processing? An interpolation application , 2017 .

[22]  David M. Dutton,et al.  A review of machine learning , 1997, The Knowledge Engineering Review.

[23]  Catherine Constable,et al.  Reconstructing the Holocene geomagnetic field , 2011 .

[24]  Catherine Constable,et al.  Geomagnetic field for 0–3 ka: 2. A new series of time‐varying global models , 2009 .

[25]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[26]  Andreas Nilsson,et al.  Reconstructing Holocene geomagnetic field variation: new methods, models and implications , 2014 .

[27]  J. Friedman Greedy function approximation: A gradient boosting machine. , 2001 .

[28]  Sreerama K. Murthy,et al.  Automatic Construction of Decision Trees from Data: A Multi-Disciplinary Survey , 1998, Data Mining and Knowledge Discovery.

[29]  Tanel Alumäe,et al.  LSTM for punctuation restoration in speech transcripts , 2015, INTERSPEECH.

[30]  Mathieu Dumberry,et al.  Eastward and westward drift of the Earth's magnetic field for the last three millennia , 2006 .

[31]  Huan Liu,et al.  A High-Precision Frequency Measurement Algorithm for FID Signal of Proton Magnetometer , 2016, IEEE Transactions on Instrumentation and Measurement.

[32]  M. Korte,et al.  The evolution of the core-surface flow over the last seven thousands years , 2008 .

[33]  Gauthier Hulot,et al.  Earth's dynamo limit of predictability , 2010 .

[34]  Nezih Mrad,et al.  Prognostics of damage growth in composite materials using machine learning techniques , 2017, 2017 IEEE International Conference on Industrial Technology (ICIT).

[35]  Gauthier Hulot,et al.  GJI Geomagnetism, rock magnetism and palaeomagnetism Earth's dynamo limit of predictability controlled by magnetic dissipation , 2011 .

[36]  Monika Korte,et al.  On the persistence of geomagnetic flux lobes in global Holocene field models , 2010 .