Deep Learning for Semantic Segmentation on Minimal Hardware

Deep learning has revolutionised many fields, but it is still challenging to transfer its success to small mobile robots with minimal hardware. Specifically, some work has been done to this effect in the RoboCup humanoid football domain, but results that are performant and efficient and still generally applicable outside of this domain are lacking. We propose an approach conceptually different from those taken previously. It is based on semantic segmentation and does achieve these desired properties. In detail, it is being able to process full VGA images in real-time on a low-power mobile processor. It can further handle multiple image dimensions without retraining, it does not require specific domain knowledge for achieving a high frame rate and it is applicable on a minimal mobile hardware.

[1]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Shuchang Zhou,et al.  DoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradients , 2016, ArXiv.

[3]  Stefan Wermter,et al.  Ball Localization for Robocup Soccer Using Convolutional Neural Networks , 2016, RoboCup.

[4]  Daniele Nardi,et al.  A Deep Learning Approach for Object Recognition with NAO Soccer Robots , 2016, RoboCup.

[5]  Igor Carron,et al.  XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks , 2016 .

[6]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[7]  Visvanathan Ramesh,et al.  Large-Scale Stochastic Scene Generation and Semantic Annotation for Deep Convolutional Neural Network Training in the RoboCup SPL , 2017, RoboCup.

[8]  Olivier Ly,et al.  Rhoban Football Club: RoboCup Humanoid Kid-Size 2016 Champion Team Paper , 2016, RoboCup.

[9]  Jacky Baltes,et al.  Humanoid Robot Detection Using Deep Learning: A Speed-Accuracy Tradeoff , 2017, RoboCup.

[10]  Reinaldo A. C. Bianchi,et al.  Towards robotic cognition using deep neural network applied in a goalkeeper robot , 2017, 2017 Latin American Robotics Symposium (LARS) and 2017 Brazilian Symposium on Robotics (SBR).

[11]  Gordon Cheng,et al.  Real-Time Vision Processing for a Soccer Playing Mobile Robot , 1997, RoboCup.

[12]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Nicolás Cruz,et al.  Using Convolutional Neural Networks in Robots with Limited Computational Resources: Detecting NAO Robots while Playing Soccer , 2017, RoboCup.

[14]  K. Dorer,et al.  Detection and Localization of Features on a Soccer Field with Feedforward Fully Convolutional Neural Networks ( FCNN ) for the Adult-Size Humanoid Robot Sweaty , 2017 .

[15]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[16]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[17]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.