A hybrid and scalable brain-inspired robotic platform

Recent years have witnessed tremendous progress of intelligent robots brought about by mimicking human intelligence. However, current robots are still far from being able to handle multiple tasks in a dynamic environment as efficiently as humans. To cope with complexity and variability, further progress toward scalability and adaptability are essential for intelligent robots. Here, we report a brain-inspired robotic platform implemented by an unmanned bicycle that exhibits scalability of network scale, quantity and diversity to handle the changing needs of different scenarios. The platform adopts rich coding schemes and a trainable and scalable neural state machine, enabling flexible cooperation of hybrid networks. In addition, an embedded system is developed using a cross-paradigm neuromorphic chip to facilitate the implementation of diverse neural networks in spike or non-spike form. The platform achieved various real-time tasks concurrently in different real-world scenarios, providing a new pathway to enhance robots’ intelligence.

[1]  Damien Querlioz,et al.  Extraction of temporally correlated features from dynamic vision sensors with spike-timing-dependent plasticity , 2012, Neural Networks.

[2]  Jeffrey L. Krichmar,et al.  Neurorobotics—A Thriving Community and a Promising Pathway Toward Intelligent Cognitive Robots , 2018, Front. Neurorobot..

[3]  Konrad P. Kording,et al.  Towards an integration of deep learning and neuroscience , 2016, bioRxiv.

[4]  Steve B. Furber,et al.  The SpiNNaker Project , 2014, Proceedings of the IEEE.

[5]  Deepak Khosla,et al.  Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition , 2014, International Journal of Computer Vision.

[6]  Wei He,et al.  Tianjic: A Unified and Scalable Chip Bridging Spike-Based and Continuous Neural Computation , 2020, IEEE Journal of Solid-State Circuits.

[7]  Jon H. Kaas,et al.  The emergence and evolution of mammalian neocortex , 1995, Trends in Neurosciences.

[8]  Rodrigo Alvarez-Icaza,et al.  Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations , 2014, Proceedings of the IEEE.

[9]  Douglas D. O'Shaughnessy,et al.  Generalized mel frequency cepstral coefficients for large-vocabulary speaker-independent continuous-speech recognition , 1999, IEEE Trans. Speech Audio Process..

[10]  Nikolaos G. Tsagarakis,et al.  iCub: the design and realization of an open humanoid platform for cognitive and neuroscience research , 2007, Adv. Robotics.

[11]  Hong Wang,et al.  Loihi: A Neuromorphic Manycore Processor with On-Chip Learning , 2018, IEEE Micro.

[12]  A. Aertsen,et al.  Spiking activity propagation in neuronal networks: reconciling different perspectives on neural coding , 2010, Nature Reviews Neuroscience.

[13]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[14]  Giacomo Indiveri,et al.  Obstacle Avoidance and Target Acquisition for Robot Navigation Using a Mixed Signal Analog/Digital Neuromorphic Processing System , 2017, Front. Neurorobot..

[15]  J. Christian Gerdes,et al.  Neural network vehicle models for high-performance automated driving , 2019, Science Robotics.

[16]  S. Schaal,et al.  Robotics and Neuroscience , 2014, Current Biology.

[17]  David A. Patterson,et al.  In-datacenter performance analysis of a tensor processing unit , 2017, 2017 ACM/IEEE 44th Annual International Symposium on Computer Architecture (ISCA).

[18]  Alexander Mathis,et al.  Resolution of nested neuronal representations can be exponential in the number of neurons. , 2012, Physical review letters.

[19]  Shuang Wu,et al.  Training and Inference with Integers in Deep Neural Networks , 2018, ICLR.

[20]  Shimon Ullman,et al.  Using neuroscience to develop artificial intelligence , 2019, Science.

[21]  Jeih-Weih Hung,et al.  Robust entropy-based endpoint detection for speech recognition in noisy environments , 1998, ICSLP.

[22]  Mingguo Zhao,et al.  Towards artificial general intelligence with hybrid Tianjic chip architecture , 2019, Nature.

[23]  Lei Deng,et al.  Spatio-Temporal Backpropagation for Training High-Performance Spiking Neural Networks , 2017, Front. Neurosci..

[24]  Karl J. Friston,et al.  Structural and Functional Brain Networks: From Connections to Cognition , 2013, Science.

[25]  Song Han,et al.  EIE: Efficient Inference Engine on Compressed Deep Neural Network , 2016, 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA).

[26]  Jiajun Wu,et al.  See, feel, act: Hierarchical learning for complex manipulation skills with multisensory fusion , 2019, Science Robotics.

[27]  Alvin I. Chen,et al.  Deep learning robotic guidance for autonomous vascular access , 2020, Nat. Mach. Intell..

[28]  Kaushik Roy,et al.  Towards spike-based machine intelligence with neuromorphic computing , 2019, Nature.

[29]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[30]  Daniel L Adams,et al.  The cortical column: a structure without a function , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.