Computational Science – ICCS 2020: 20th International Conference, Amsterdam, The Netherlands, June 3–5, 2020, Proceedings, Part III

Various approaches based on both computational science and data science/machine learning have been proposed with the development of observation systems and network technologies. Computation cost associated with computational science can be reduced by introducing the methods based on data science/machine learning. In the present paper, we focus on a method to estimate inner soil structure via wave propagation analysis. It is regarded as one of the parameter optimization approaches using observation data on the surface. This application is in great demand to ensure better reliability in numerical simulations. Typical optimization requires many forward analyses; thus, massive computation cost is required. We propose an approach to substitute evaluation using neural networks for most cases of forward analyses and to reduce the number of forward analyses. Forward analyses in the proposed method are used for producing the training data for a neural network; thereby they can be computed independently, and the actual elapsed time can be reduced by using a large-scale supercomputer. We demonstrated that the inner soil structure was estimated with the sufficient accuracy for practical damage evaluation. We also confirmed that the proposed method achieved estimating parameters within a shorter timeframe compared to a typical approach based on simulated annealing.

[1]  Jure Leskovec,et al.  Motifs in Temporal Networks , 2016, WSDM.

[2]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[3]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[4]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[5]  Alexander M. Rush,et al.  Structured Attention Networks , 2017, ICLR.

[6]  Jürgen Schmidhuber,et al.  Bidirectional LSTM Networks for Improved Phoneme Classification and Recognition , 2005, ICANN.

[7]  Lada A. Adamic,et al.  Friends and neighbors on the Web , 2003, Soc. Networks.

[8]  Phil Blunsom,et al.  Recurrent Continuous Translation Models , 2013, EMNLP.

[9]  I. Jolliffe,et al.  A Modified Principal Component Technique Based on the LASSO , 2003 .

[10]  Yoshua Bengio,et al.  Maxout Networks , 2013, ICML.

[11]  Srikanta J. Bedathur,et al.  Towards time-aware link prediction in evolving social networks , 2009, SNA-KDD '09.

[12]  Miles Osborne,et al.  Statistical Machine Translation , 2010, Encyclopedia of Machine Learning and Data Mining.

[13]  Isaac Olusegun Osunmakinde,et al.  Temporality in Link Prediction: Understanding Social Complexity , 2009 .

[14]  Christopher D. Manning,et al.  Compositional Attention Networks for Machine Reasoning , 2018, ICLR.

[15]  George Kurian,et al.  Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation , 2016, ArXiv.

[16]  A. Barabasi,et al.  Evolution of the social network of scientific collaborations , 2001, cond-mat/0104162.

[17]  Ryutaro Ichise,et al.  Finding Experts by Link Prediction in Co-authorship Networks , 2007, FEWS.

[18]  Christopher D. Manning,et al.  Learning to recognize features of valid textual entailments , 2006, NAACL.

[19]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[20]  Jon M. Kleinberg,et al.  The link-prediction problem for social networks , 2007, J. Assoc. Inf. Sci. Technol..

[21]  Lin Yao,et al.  The 7 th International Conference on Ambient Systems , Networks and Technologies ( ANT 2016 ) Link Prediction Based on Common-Neighbors for Dynamic Social Network , 2016 .

[22]  Kourosh Modarresi,et al.  An Evaluation Metric for Content Providing Models, Recommendation Systems, and Online Campaigns , 2019, ICCS.

[23]  Alex Graves,et al.  Sequence Transduction with Recurrent Neural Networks , 2012, ArXiv.

[24]  Christopher D. Manning Computational Linguistics and Deep Learning , 2015, Computational Linguistics.

[25]  김상혁 영어의 능격성(Ergativity) , 2003 .

[26]  Christopher D. Manning,et al.  Natural Logic for Textual Inference , 2007, ACL-PASCAL@ACL.

[27]  Ryan A. Rossi,et al.  The Network Data Repository with Interactive Graph Analytics and Visualization , 2015, AAAI.

[28]  Yong Tang,et al.  Link prediction based on time-varied weight in co-authorship network , 2014, Proceedings of the 2014 IEEE 18th International Conference on Computer Supported Cooperative Work in Design (CSCWD).

[29]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[30]  Holger Schwenk,et al.  Continuous Space Language Models for Statistical Machine Translation , 2006, ACL.

[31]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[32]  Mihai Surdeanu,et al.  The Stanford CoreNLP Natural Language Processing Toolkit , 2014, ACL.

[33]  Hui Li,et al.  A Deep Learning Approach to Link Prediction in Dynamic Networks , 2014, SDM.

[34]  Alex Graves,et al.  Generating Sequences With Recurrent Neural Networks , 2013, ArXiv.

[35]  Jeffrey Heer,et al.  Differentiating language usage through topic models , 2013 .

[36]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[37]  Gene H. Golub,et al.  Calculating the singular values and pseudo-inverse of a matrix , 2007, Milestones in Matrix Computation.

[38]  Ryutaro Ichise,et al.  Time Aware Index for Link Prediction in Social Networks , 2011, DaWaK.

[39]  Yiming Yang,et al.  The Enron Corpus: A New Dataset for Email Classi(cid:12)cation Research , 2004 .

[40]  Nicol N. Schraudolph,et al.  Fast Curvature Matrix-Vector Products for Second-Order Gradient Descent , 2002, Neural Computation.

[41]  Gene H. Golub,et al.  An analysis of the total least squares problem , 1980, Milestones in Matrix Computation.

[42]  Daniel Jurafsky,et al.  Which words are hard to recognize? Prosodic, lexical, and disfluency factors that increase speech recognition error rates , 2010, Speech Commun..

[43]  Kathleen M. Carley,et al.  Patterns and dynamics of users' behavior and interaction: Network analysis of an online community , 2009, J. Assoc. Inf. Sci. Technol..

[44]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[45]  Ash A. Alizadeh,et al.  'Gene shaving' as a method for identifying distinct sets of genes with similar expression patterns , 2000, Genome Biology.

[46]  Reda Alhajj,et al.  Unsupervised Link Prediction Based on Time Frames in Weighted–Directed Citation Networks , 2017 .

[47]  Mingzhe Wang,et al.  LINE: Large-scale Information Network Embedding , 2015, WWW.

[48]  Kourosh Modarresi,et al.  An Efficient Deep Learning Model for Recommender Systems , 2018, ICCS.

[49]  Trevor Hastie,et al.  Handwritten Digit Recognition via Deformable Prototypes , 1994 .

[50]  Razvan Pascanu,et al.  How to Construct Deep Recurrent Neural Networks , 2013, ICLR.

[51]  Kourosh Modarresi,et al.  Standardization of Featureless Variables for Machine Learning Models Using Natural Language Processing , 2018, ICCS.

[52]  Soner Aydın Link prediction models for recommendation in academic collaboration network of Turkey , 2017 .

[53]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[54]  Bowen Zhou,et al.  A Structured Self-attentive Sentence Embedding , 2017, ICLR.

[55]  Yan Liu,et al.  DynGEM: Deep Embedding Method for Dynamic Graphs , 2018, ArXiv.

[56]  Alexander J. Smola,et al.  Friend or frenemy?: predicting signed ties in social networks , 2012, SIGIR '12.

[57]  Daniel Marcu,et al.  Statistical Phrase-Based Translation , 2003, NAACL.

[58]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[59]  Gene H. Golub,et al.  A local regularization method using multiple regularization levels , 2007 .

[60]  Razvan Pascanu,et al.  On the difficulty of training recurrent neural networks , 2012, ICML.

[61]  Leo Katz,et al.  A new status index derived from sociometric analysis , 1953 .

[62]  Christopher D. Manning,et al.  Effective Approaches to Attention-based Neural Machine Translation , 2015, EMNLP.

[63]  Tong Wang,et al.  Link Prediction in Evolving Networks Based on Popularity of Nodes , 2017, Scientific Reports.

[64]  S. N. Dorogovtsev,et al.  Evolution of networks , 2001, cond-mat/0106144.

[65]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[66]  Klaus-Robert Müller,et al.  Efficient BackProp , 2012, Neural Networks: Tricks of the Trade.

[67]  B. Hofmann Regularization for Applied Inverse and III-Posed Problems , 1986 .

[68]  Gene H. Golub,et al.  Generalized cross-validation as a method for choosing a good ridge parameter , 1979, Milestones in Matrix Computation.

[69]  I. Jolliffe Rotation of principal components: choice of normalization constraints , 1995 .

[70]  Andrés Montoyo,et al.  Advances on natural language processing , 2007, Data Knowl. Eng..

[71]  Phil Blunsom,et al.  Multilingual Distributed Representations without Word Alignment , 2013, ICLR 2014.

[72]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[73]  Dit-Yan Yeung,et al.  Relational Deep Learning: A Deep Latent Variable Model for Link Prediction , 2017, AAAI.

[74]  M. Newman Clustering and preferential attachment in growing networks. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[75]  Kourosh Modarresi,et al.  Generalized Variable Conversion Using K-means Clustering and Web Scraping , 2018, ICCS.

[76]  Jürgen Schmidhuber,et al.  Framewise phoneme classification with bidirectional LSTM and other neural network architectures , 2005, Neural Networks.

[77]  Christophe Diot,et al.  Impact of Human Mobility on Opportunistic Forwarding Algorithms , 2007, IEEE Transactions on Mobile Computing.

[78]  Yoshua Bengio,et al.  Gradient Flow in Recurrent Nets: the Difficulty of Learning Long-Term Dependencies , 2001 .