Performance and energy-efficient implementation of a smart city application on FPGAs

The continuous growth of modern cities and the request for better quality of life, coupled with the increased availability of computing resources, lead to an increased attention to smart city services. Smart cities promise to deliver a better life to their inhabitants while simultaneously reducing resource requirements and pollution. They are thus perceived as a key enabler to sustainable growth. Out of many other issues, one of the major concerns for most cities in the world is traffic, which leads to a huge waste of time and energy, and to increased pollution. To optimize traffic in cities, one of the first steps is to get accurate information in real time about the traffic flows in the city. This can be achieved through the application of automated video analytics to the video streams provided by a set of cameras distributed throughout the city. Image sequence processing can be performed both peripherally and centrally. In this paper, we argue that, since centralized processing has several advantages in terms of availability, maintainability and cost, it is a very promising strategy to enable effective traffic management even in large cities. However, the computational costs are enormous, and thus require an energy-efficient High-Performance Computing approach. Field Programmable Gate Arrays (FPGAs) provide comparable computational resources to CPUs and GPUs, yet require much lower amounts of energy per operation (around 6 $$\times$$ × and 10 $$\times$$ × for the application considered in this case study). They are thus preferred resources to reduce both energy supply and cooling costs in the huge datacenters that will be needed by Smart Cities. In this paper, we describe efficient implementations of high-performance algorithms that can process traffic camera image sequences to provide traffic flow information in real-time at a low energy and power cost.

[1]  Bradley Malin,et al.  Preserving privacy by de-identifying face images , 2005, IEEE Transactions on Knowledge and Data Engineering.

[2]  Fei-Yue Wang,et al.  Data-Driven Intelligent Transportation Systems: A Survey , 2011, IEEE Transactions on Intelligent Transportation Systems.

[3]  Luciano Lavagno,et al.  Efficient FPGA Implementation of OpenCL High-Performance Computing Applications via High-Level Synthesis , 2017, IEEE Access.

[4]  Ioannis A. Tsoukalas,et al.  The Implementation Model of a Digital City. The Case Study of the Digital City of Trikala, Greece , 2006 .

[5]  Karla Brkić,et al.  Towards Reversible De-Identification in Video Sequences Using 3D Avatars and Steganography , 2015, ArXiv.

[6]  Kevin I-Kai Wang,et al.  Trusting the Computer in Computer Vision: A Privacy-Affirming Framework , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[7]  Helen J. Wang,et al.  World-Driven Access Control for Continuous Sensing , 2014, CCS.

[8]  Karin Strauss,et al.  Accelerating Deep Convolutional Neural Networks Using Specialized Hardware , 2015 .

[9]  Daniel Gajski,et al.  Introduction to high-level synthesis , 1994, IEEE Design & Test of Computers.

[10]  Ashwin Machanavajjhala,et al.  MarkIt: privacy markers for protecting visual secrets , 2014, UbiComp Adjunct.

[11]  Peter Cruickshank,et al.  Creating Smart-er Cities: An Overview , 2011 .

[12]  Fei-Yue Wang,et al.  A Multi-view Learning Approach to Foreground Detection for Traffic Surveillance Applications , 2016, IEEE Transactions on Vehicular Technology.

[13]  Akila Gothandaraman,et al.  Comparing Hardware Accelerators in Scientific Applications: A Case Study , 2011, IEEE Transactions on Parallel and Distributed Systems.

[14]  Yong Wang,et al.  SDA: Software-defined accelerator for large-scale DNN systems , 2014, 2014 IEEE Hot Chips 26 Symposium (HCS).

[15]  Sergio A. Velastin,et al.  A Review of Computer Vision Techniques for the Analysis of Urban Traffic , 2011, IEEE Transactions on Intelligent Transportation Systems.

[16]  José L. Martínez Lastra,et al.  Integrating smart city services using Arrowhead framework , 2016, IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society.

[17]  Hironobu Fujiyoshi,et al.  A System for Video Surveillance and Monitoring CMU VSAM Final Report , 1999 .

[18]  Nicos Komninos,et al.  Intelligent Cities: Innovation, Knowledge Systems and Digital Spaces , 2002 .

[19]  Takeo Kanade,et al.  A System for Video Surveillance and Monitoring , 2000 .

[20]  Peter Haeussermann THE PROMETHEUS PROGRAMME , 1990 .

[21]  Mohan M. Trivedi,et al.  A Survey of Vision-Based Trajectory Learning and Analysis for Surveillance , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Frank Kienle,et al.  An Energy Efficient FPGA Accelerator for Monte Carlo Option Pricing with the Heston Model , 2011, 2011 International Conference on Reconfigurable Computing and FPGAs.

[23]  Wim Vanderbauwhede,et al.  High-Performance Computing Using FPGAs , 2013 .

[24]  M. Rodríguez-Bolívar,et al.  Transforming City Governments for Successful Smart Cities , 2015 .

[25]  M. Tolga Akçura,et al.  How to make global cities: Information communication technologies and macro-level variables , 2014 .

[26]  Agusti Solanas,et al.  Understanding trust in privacy-aware video surveillance systems , 2015, International Journal of Information Security.

[27]  Paul M. Carpenter,et al.  EUROSERVER: Energy Efficient Node for European Micro-Servers , 2014, 2014 17th Euromicro Conference on Digital System Design.

[28]  Stijn De Beugher,et al.  The Battle of the Giants - A Case Study of GPU vs FPGA Optimisation for Real-time Image Processing , 2014, PECCS.

[29]  Yohan Dupuis,et al.  A Survey of Vision-Based Traffic Monitoring of Road Intersections , 2016, IEEE Transactions on Intelligent Transportation Systems.

[30]  Mohan M. Trivedi,et al.  Understanding vehicular traffic behavior from video: a survey of unsupervised approaches , 2013, J. Electronic Imaging.

[31]  Juan Martin,et al.  A Low-Complexity Vision-Based System for Real-Time Traffic Monitoring , 2017, IEEE Transactions on Intelligent Transportation Systems.

[32]  Leonidas Anthopoulos,et al.  Understanding the Smart City Domain: A Literature Review , 2015 .

[33]  Ming Tang,et al.  Hierarchical and Networked Vehicle Surveillance in ITS: A Survey , 2015, IEEE transactions on intelligent transportation systems (Print).

[34]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[35]  B. Ulmer VITA-an autonomous road vehicle (ARV) for collision avoidance in traffic , 1992, Proceedings of the Intelligent Vehicles `92 Symposium.

[36]  Vinay Sudhakaran,et al.  Estimation of intersection traffic density on decentralized architectures with deep networks , 2017, 2017 International Smart Cities Conference (ISC2).

[37]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.