A Quantum Spatial Graph Convolutional Neural Network using Quantum Passing Information

In this paper, we develop a new Quantum Spatial Graph Convolutional Neural Network (QSGCNN) model that can directly learn a classification function for graphs of arbitrary sizes. Unlike state-of-the-art Graph Convolutional Neural Network (GCN) models, the proposed QSGCNN model incorporates the process of identifying transitive aligned vertices between graphs, and transforms arbitrary sized graphs into fixed-sized aligned vertex grid structures. To further learn representative graph characteristics, a new quantum spatial graph convolution is proposed and employed to extract multi-scale vertex features, in terms of quantum passing information between grid vertices of each graph. Since the quantum spatial convolution preserves the property of the input grid structures, the proposed QSGCNN model allows to directly employ the traditional convolutional neural network to further learn from the global graph topology, providing an end-to-end deep learning architecture that integrates the graph representation and learning in the quantum spatial graph convolution layer and the traditional convolutional layer for graph classifications. We demonstrate the effectiveness of the proposed QSGCNN model in terms of the theoretical connections to state-of-the-art methods. The proposed QSGCNN model addresses the shortcomings of information loss and imprecise information representation arising in existing GCN models associated with SortPooling or SumPooling layers. Experimental results on benchmark graph classification datasets demonstrate the effectiveness of the proposed QSGCNN model.

[1]  Edwin R. Hancock,et al.  Local-global nested graph kernels using nested complexity traces , 2020, Pattern Recognit. Lett..

[2]  Edwin R. Hancock,et al.  Quantum kernels for unattributed graphs using discrete-time quantum walks , 2017, Pattern Recognit. Lett..

[3]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[4]  Edwin R. Hancock,et al.  Attributed Graph Kernels Using the Jensen-Tsallis q-Differences , 2014, ECML/PKDD.

[5]  Alexander Gammerman,et al.  Learning by Transduction , 1998, UAI.

[6]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[7]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[8]  Hisashi Kashima,et al.  Marginalized Kernels Between Labeled Graphs , 2003, ICML.

[9]  Roman Garnett,et al.  Propagation kernels: efficient graph kernels from propagated information , 2015, Machine Learning.

[10]  Edwin R. Hancock,et al.  An Aligned Subtree Kernel for Weighted Graphs , 2015, ICML.

[11]  Yefeng Zheng,et al.  Deep Learning and Convolutional Neural Networks for Medical Image Computing , 2017, Advances in Computer Vision and Pattern Recognition.

[12]  E. Farhi,et al.  Quantum computation and decision trees , 1997, quant-ph/9706062.

[13]  Karsten M. Borgwardt,et al.  The skew spectrum of graphs , 2008, ICML '08.

[14]  Edwin R. Hancock,et al.  Depth-based complexity traces of graphs , 2014, Pattern Recognit..

[15]  Yixin Chen,et al.  An End-to-End Deep Learning Architecture for Graph Classification , 2018, AAAI.

[16]  Jasper Snoek,et al.  Spectral Representations for Convolutional Neural Networks , 2015, NIPS.

[17]  Kaisheng Yao,et al.  Deep neural support vector machines for speech recognition , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[18]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[19]  Edwin R. Hancock,et al.  Depth-based hypergraph complexity traces from directed line graphs , 2016, Pattern Recognit..

[20]  Zaïd Harchaoui,et al.  Image Classification with Segmentation Graph Kernels , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Samy Bengio,et al.  Show and tell: A neural image caption generator , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Edwin R. Hancock,et al.  An Edge-Based Matching Kernel Through Discrete-Time Quantum Walks , 2015, ICIAP.

[23]  Kurt Mehlhorn,et al.  Weisfeiler-Lehman Graph Kernels , 2011, J. Mach. Learn. Res..

[24]  Chris D. Godsil,et al.  Average mixing of continuous quantum walks , 2011, J. Comb. Theory, Ser. A.

[25]  David Haussler,et al.  Convolution kernels on discrete structures , 1999 .

[26]  Joan Bruna,et al.  Spectral Networks and Locally Connected Networks on Graphs , 2013, ICLR.

[27]  Horst Bunke,et al.  Bridging the Gap between Graph Edit Distance and Kernel Machines , 2007, Series in Machine Perception and Artificial Intelligence.

[28]  Donald F. Towsley,et al.  Diffusion-Convolutional Neural Networks , 2015, NIPS.

[29]  Pinar Yanardag,et al.  Deep Graph Kernels , 2015, KDD.

[30]  Joan Bruna,et al.  Deep Convolutional Networks on Graph-Structured Data , 2015, ArXiv.

[31]  Nikos Komodakis,et al.  Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphs , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Ernest Valveny,et al.  Graph embedding in vector spaces by node attribute statistics , 2012, Pattern Recognit..

[33]  Nils M. Kriege,et al.  Subgraph Matching Kernels for Attributed Graphs , 2012, ICML.

[34]  Alán Aspuru-Guzik,et al.  Convolutional Networks on Graphs for Learning Molecular Fingerprints , 2015, NIPS.

[35]  Vincent Gripon,et al.  Generalizing the Convolution Operator to Extend CNNs to Irregular Domains , 2016, ArXiv.

[36]  Mathias Niepert,et al.  Learning Convolutional Neural Networks for Graphs , 2016, ICML.

[37]  Kaspar Riesen,et al.  Graph Classification by Means of Lipschitz Embedding , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[38]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[39]  Michalis Vazirgiannis,et al.  Classifying Graphs as Images with Convolutional Neural Networks , 2017, ArXiv.

[40]  Edwin R. Hancock,et al.  Pattern Vectors from Algebraic Graph Theory , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Hans-Peter Kriegel,et al.  Shortest-path kernels on graphs , 2005, Fifth IEEE International Conference on Data Mining (ICDM'05).