Will Capsule Networks overcome Convolutional Neural Networks on Pedestrian Walking Direction ?*

Thousands of people are dying every year due to road accidents; in fact 23% of world fatal accidents are pedestrians related, where 40% of them occur in Africa as reported by the World Health Organisation (WHO). Predicting the walking direction of a pedestrian could help to avoid an eventual accident. Existing studies can not handle pose and orientation transformations of the input object contrary to our proposed method. This paper describes a novel approach to determine the pedestrian orientation using Capsule Networks (CapsNet) based scheme. CapsNet are a new deep learning architecture that overcome some limitations of the existing studies, they are group of neurons invariant to rotation and affine transformations, which represent a specific interest to this work. Capsule Networks predicts the walking directions of pedestrians to prevent such mortal accidents, using four main walking directions (front, back, left and right).For this purpose, a new pedestrians dataset gathered from the most popular cities in Morocco is collected to be studied and used as a proof of the proposed approach. To enhance this proposed approach, we evaluated it using Daimler dataset and compared it to Convolutional Neural Networks (CNN) architectures.Experimental results reveal that the performance of the proposed approach reaches an accuracy of 97.60% on daimler dataset and 73.64% on our Moroccan collected dataset.

[1]  Pietro Perona,et al.  Fast Feature Pyramids for Object Detection , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Amara Dinesh Kumar,et al.  Novel Deep Learning Model for Traffic Sign Detection Using Capsule Networks , 2018, ArXiv.

[3]  Tarak Gandhi,et al.  Pedestrian collision avoidance systems: a survey of computer vision based recent studies , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[4]  Yi He,et al.  Pedestrian-vehicular collision avoidance based on vision system , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[5]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[7]  Geoffrey E. Hinton,et al.  Dynamic Routing Between Capsules , 2017, NIPS.

[8]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[9]  T. Poggio,et al.  Direction estimation of pedestrian from multiple still images , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[10]  Franck Davoine,et al.  Detection of pedestrians at far distance , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Rama Chellappa,et al.  Designing Deep Convolutional Neural Networks for Continuous Object Orientation Estimation , 2017, ArXiv.

[12]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Sergio Orts,et al.  Recognizing Pedestrian Direction Using Convolutional Neural Networks , 2017, IWANN.

[14]  M.M. Trivedi,et al.  Image based estimation of pedestrian orientation for improving path prediction , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[15]  Xiaogang Wang,et al.  Pedestrian detection aided by deep learning semantic tasks , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Liang Lin,et al.  Is Faster R-CNN Doing Well for Pedestrian Detection? , 2016, ECCV.

[17]  A. Fascioli,et al.  Pedestrian Protection Systems : Issues , Survey , and Challenges , 2007 .

[18]  Robert Anderson,et al.  Issues and challenges for pedestrian active safety systems based on real world accidents. , 2015, Accident; analysis and prevention.