Neural Network Syntax Analyzer for Embedded Standardized Deep Learning

Deep learning frameworks based on the neural network model have attracted a lot of attention recently for their potential in various applications. Accordingly, recent developments in the fields of deep learning configuration platforms have led to renewed interests in neural network unified format (NNUF) for standardized deep learning computation. The attempt of making NNUF becomes quite challenging because primarily used platforms change over time and the structures of deep learning computation models are continuously evolving. This paper presents the design and implementation of a parser of NNUF for standardized deep learning computation. We call the platform implemented with the neural network exchange framework (NNEF) standard as the NNUF. This framework provides platform-independent processes for configuring and training deep learning neural networks, where the independence is offered by the NNUF model. This model allows us to configure all components of neural network graphs. Our framework also allows the resulting graph to be easily shared with other platform-dependent descriptions which configure various neural network architectures in their own ways. This paper presents the details of the parser design, JavaCC-based implementation, and initial results.

[1]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[2]  D. Rubtsov,et al.  A unified format for trained neural network description , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[3]  Yunde Jia,et al.  Vehicle Type Classification Using Unsupervised Convolutional Neural Network , 2014, 2014 22nd International Conference on Pattern Recognition.

[4]  Xiao-yan Tang,et al.  Agent programming language and its complier implementation based on JavaCC , 2010, 2010 International Conference on Future Information Technology and Management Engineering.

[5]  Alan Fern,et al.  Schema Independent Relational Learning , 2017, SIGMOD Conference.

[6]  Lutz Prechelt,et al.  CuPit-2: portable and efficient high-level parallel programming of neural networks , 1999 .

[7]  Chris Jermaine,et al.  The BUDS Language for Distributed Bayesian Machine Learning , 2017, SIGMOD Conference.

[8]  Xin Zhang,et al.  TFX: A TensorFlow-Based Production-Scale Machine Learning Platform , 2017, KDD.

[9]  G. Debreczeni,et al.  Neural Network Exchange Format , 2019 .

[10]  MyungJae Shin,et al.  Top-down parsing for Neural Network Exchange Format (NNEF) in TensorFlow-based deep learning computation , 2018, 2018 International Conference on Information Networking (ICOIN).

[11]  Pierre Bourhis,et al.  JSON: Data model, Query languages and Schema specification , 2017, PODS.