Semi-Supervised Graph Structure Learning on Neuromorphic Computers

Graph convolutional networks have risen in popularity in recent years to tackle problems that are naturally represented as graphs. However, real-world graphs are often sparse, which means that implementing them on traditional accelerators such as graphics processing units (GPUs) can lead to inefficient utilization of the hardware. Spiking neuromorphic computers natively implement network-like computation and have been shown to be successful at implementing certain types of graph computations. In this work, we evaluate the use of a simulated network of spiking neurons to perform semi-supervised learning on graph data using only the graph structure. We demonstrate that our neuromorphic approach provides comparable results to graph convolutional network results, and we discuss the opportunities for using neuromorphic computers for this task in the future.

[1]  Seung-Hwan Lim,et al.  Versatile feature learning with graph convolutions and graph structures , 2021, 2021 International Conference on Data Mining Workshops (ICDMW).

[2]  Chang-Tien Lu,et al.  Graph Convolutional Networks with Kalman Filtering for Traffic Prediction , 2020, SIGSPATIAL/GIS.

[3]  Yihao Fang,et al.  Optimization of Graph Neural Networks with Natural Gradient Descent , 2020, 2020 IEEE International Conference on Big Data (Big Data).

[4]  Ojas Parekh,et al.  Provable Neuromorphic Advantages for Computing Shortest Paths , 2020, SPAA.

[5]  Catherine D. Schuman,et al.  Neuromorphic Graph Algorithms: Extracting Longest Shortest Paths and Minimum Spanning Trees , 2020, NICE.

[6]  Jure Leskovec,et al.  Unifying Graph Convolutional Neural Networks and Label Propagation , 2020, ArXiv.

[7]  Jiayu Zhou,et al.  Graph convolutional networks for computational drug development and discovery , 2019, Briefings Bioinform..

[8]  Kathleen E. Hamilton,et al.  Shortest Path and Neighborhood Subgraph Extraction on a Spiking Memristive Neuromorphic Implementation , 2019, NICE '19.

[9]  Yuan Luo,et al.  Graph Convolutional Networks for Text Classification , 2018, AAAI.

[10]  Jeffrey C Grossman,et al.  Crystal Graph Convolutional Neural Networks for an Accurate and Interpretable Prediction of Material Properties. , 2017, Physical review letters.

[11]  Alexander A. Alemi,et al.  Watch Your Step: Learning Node Embeddings via Graph Attention , 2017, NeurIPS.

[12]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[13]  Catherine D. Schuman,et al.  A Survey of Neuromorphic Computing and Neural Networks in Hardware , 2017, ArXiv.

[14]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[15]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[16]  Ruslan Salakhutdinov,et al.  Revisiting Semi-Supervised Learning with Graph Embeddings , 2016, ICML.

[17]  Lise Getoor,et al.  Collective Classification in Network Data , 2008, AI Mag..