Transfer learning in large-scale ocean bottom seismic wavefield reconstruction

Achieving desirable receiver sampling in ocean bottom acquisition is often not possible because of cost considerations. Assuming adequate source sampling is available, which is achievable by virtue of reciprocity and the use of modern randomized (simultaneous-source) marine acquisition technology, we are in a position to train convolutional neural networks (CNNs) to bring the receiver sampling to the same spatial grid as the dense source sampling. To accomplish this task, we form training pairs consisting of densely sampled data and artificially subsampled data using a reciprocity argument and the assumption that the source-site sampling is dense. While this approach has successfully been used on the recovery monochromatic frequency slices, its application in practice calls for wavefield reconstruction of time-domain data. Despite having the option to parallelize, the overall costs of this approach can become prohibitive if we decide to carry out the training and recovery independently for each frequency. Because different frequency slices share information, we propose the use the method of transfer training to make our approach computationally more efficient by warm starting the training with CNN weights obtained from a neighboring frequency slices. If the two neighboring frequency slices share information, we would expect the training to improve and converge faster. Our aim is to prove this principle by carrying a series of carefully selected experiments on a relatively large-scale five-dimensional data synthetic data volume associated with wide-azimuth 3D ocean bottom node acquisition. From these experiments, we observe that by transfer training we are able t significantly speedup in the training, specially at relatively higher frequencies where consecutive frequency slices are more correlated.

[1]  Kshitij Dwivedi,et al.  Representation Similarity Analysis for Efficient Task Taxonomy & Transfer Learning , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Dehui Yang,et al.  Weighted Matrix Completion and Recovery With Prior Subspace Information , 2018, IEEE Transactions on Information Theory.

[3]  Felix J. Herrmann,et al.  Deep-learning based ocean bottom seismic wavefield recovery , 2019, SEG Technical Program Expanded Abstracts 2019.

[4]  Felix J. Herrmann,et al.  The importance of transfer learning in seismic modeling and imaging , 2019, GEOPHYSICS.

[5]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[6]  Felix J. Herrmann,et al.  Low-rank Promoting Transformations and Tensor Interpolation - Applications to Seismic Data Denoising , 2014 .

[7]  M. Sacchi,et al.  Separation and reconstruction of simultaneous source data via iterative rank reduction , 2015 .

[8]  Eric Eaton,et al.  An automated measure of MDP similarity for transfer in reinforcement learning , 2014, AAAI 2014.

[9]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Felix J. Herrmann,et al.  Seismic Data Reconstruction with Generative Adversarial Networks , 2018, 80th EAGE Conference and Exhibition 2018.

[11]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[12]  Jorge Nocedal,et al.  Optimization Methods for Large-Scale Machine Learning , 2016, SIAM Rev..

[13]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Rajiv Kumar,et al.  Source separation for simultaneous towed-streamer marine acquisition — A compressed sensing approach , 2015 .

[15]  Hassan Mansour,et al.  Efficient matrix completion for seismic data reconstruction , 2015 .

[16]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[17]  M. Sacchi,et al.  Simultaneous seismic data denoising and reconstruction via multichannel singular spectrum analysis , 2011 .

[18]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[19]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[20]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[21]  Felix J. Herrmann,et al.  Off-the-Grid Low-Rank Matrix Recovery and Seismic Data Reconstruction , 2016, IEEE Journal of Selected Topics in Signal Processing.

[22]  Yoshua Bengio,et al.  Deep Learning of Representations for Unsupervised and Transfer Learning , 2011, ICML Unsupervised and Transfer Learning.

[23]  Felix J. Herrmann,et al.  High-frequency wavefield recovery with weighted matrix factorizations , 2019, SEG Technical Program Expanded Abstracts 2019.