Identity-Aware Attribute Recognition via Real-Time Distributed Inference in Mobile Edge Clouds

With the development of deep learning technologies, attribute recognition and person re-identification (re-ID) have attracted extensive attention and achieved continuous improvement via executing computing-intensive deep neural networks in cloud datacenters. However, the datacenter deployment cannot meet the real-time requirement of attribute recognition and person re-ID, due to the prohibitive delay of backhaul networks and large data transmissions from cameras to datacenters. A feasible solution thus is to employ mobile edge clouds (MEC) within the proximity of cameras and enable distributed inference. In this paper, we design novel models for pedestrian attribute recognition with re-ID in an MEC-enabled camera monitoring system. We also investigate the problem of distributed inference in the MEC-enabled camera network. To this end, we first propose a novel inference framework with a set of distributed modules, by jointly considering the attribute recognition and person re-ID. We then devise a learning-based algorithm for the distributions of the modules of the proposed distributed inference framework, considering the dynamic MEC-enabled camera network with uncertainties. We finally evaluate the performance of the proposed algorithm by both simulations with real datasets and system implementation in a real testbed. Evaluation results show that the performance of the proposed algorithm with distributed inference framework is promising, by reaching the accuracies of attribute recognition and person identification up to 92.9% and 96.6% respectively, and significantly reducing the inference delay by at least 40.6% compared with existing methods.

[1]  Jian-Huang Lai,et al.  Supplementary Material for “Unsupervised Person Re-identification by Soft Multilabel Learning” , 2019 .

[2]  Stefan Roth,et al.  MOT16: A Benchmark for Multi-Object Tracking , 2016, ArXiv.

[3]  Yi Yang,et al.  Unlabeled Samples Generated by GAN Improve the Person Re-identification Baseline in Vitro , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[4]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Yi Yang,et al.  Dual-Path Convolutional Image-Text Embedding , 2017, ArXiv.

[6]  Weifa Liang,et al.  NFV-Enabled Multicasting in Mobile Edge Clouds with Resource Sharing , 2019, ICPP.

[7]  Soo-Mook Moon,et al.  IONN: Incremental Offloading of Neural Network Computations from Mobile Devices to Edge Servers , 2018, SoCC.

[8]  Stefan Roth,et al.  MOTChallenge 2015: Towards a Benchmark for Multi-Target Tracking , 2015, ArXiv.

[9]  Kaiqi Huang,et al.  Multi-attribute learning for pedestrian attribute recognition in surveillance scenarios , 2015, 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR).

[10]  Xin Zhao,et al.  Grouping Attribute Recognition for Pedestrian with Joint Recurrent Learning , 2018, IJCAI.

[11]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[12]  Michael Jones,et al.  An improved deep learning architecture for person re-identification , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Paramvir Bahl,et al.  VideoEdge: Processing Camera Streams using Hierarchical Clusters , 2018, 2018 IEEE/ACM Symposium on Edge Computing (SEC).

[14]  Trevor N. Mudge,et al.  Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge , 2017, ASPLOS.

[15]  Shiliang Zhang,et al.  Multi-type attributes driven multi-camera person re-identification , 2018, Pattern Recognit..

[16]  Marco Fiore,et al.  To Cache or Not To Cache? , 2009, IEEE INFOCOM 2009.

[17]  Rainer Stiefelhagen,et al.  Person Re-identification by Deep Learning Attribute-Complementary Information , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[18]  Xin Zhao,et al.  Recurrent Attention Model for Pedestrian Attribute Recognition , 2019, AAAI.

[19]  Weifa Liang,et al.  QoS-Aware VNF Placement and Service Chaining for IoT Applications in Multi-Tier Mobile Edge Networks , 2020, ACM Trans. Sens. Networks.

[20]  Weifa Liang,et al.  NFV-Enabled IoT Service Provisioning in Mobile Edge Clouds , 2020 .

[21]  Klara Nahrstedt,et al.  DROPLET: Distributed Operator Placement for IoT Applications Spanning Edge and Cloud Resources , 2018, 2018 IEEE 11th International Conference on Cloud Computing (CLOUD).

[22]  Houqiang Li,et al.  Local Convolutional Neural Networks for Person Re-Identification , 2018, ACM Multimedia.

[23]  Qi Tian,et al.  Scalable Person Re-identification: A Benchmark , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[24]  Paramvir Bahl,et al.  Real-Time Video Analytics: The Killer App for Edge Computing , 2017, Computer.

[25]  Weifa Liang,et al.  Efficient Algorithms for Delay-Aware NFV-Enabled Multicasting in Mobile Edge Clouds With Resource Sharing , 2020, IEEE Transactions on Parallel and Distributed Systems.

[26]  Junjie Yan,et al.  Localization Guided Learning for Pedestrian Attribute Recognition , 2018, BMVC.

[27]  Weifa Liang,et al.  Collaborate or Separate? Distributed Service Caching in Mobile Edge Clouds , 2020, IEEE INFOCOM 2020 - IEEE Conference on Computer Communications.

[28]  Ioannis A. Kakadiaris,et al.  Deep Imbalanced Attribute Classification using Visual Attention Aggregation , 2018, ECCV.

[29]  Qi Tian,et al.  An End-to-End Foreground-Aware Network for Person Re-Identification , 2021, IEEE Transactions on Image Processing.

[30]  Bo Ren,et al.  Sequence-based Person Attribute Recognition with Joint CTC-Attention Model , 2018, ArXiv.

[31]  Weifa Liang,et al.  Task Offloading with Network Function Requirements in a Mobile Edge-Cloud Network , 2019, IEEE Transactions on Mobile Computing.

[32]  Qi Tian,et al.  Progressive Unsupervised Person Re-Identification by Tracklet Association With Spatio-Temporal Regularization , 2019, IEEE Transactions on Multimedia.

[33]  Zhongming Jin,et al.  Sharp Attention Network via Adaptive Sampling for Person Re-Identification , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  Zhuo Chen,et al.  Bandwidth-Efficient Live Video Analytics for Drones Via Edge Computing , 2018, 2018 IEEE/ACM Symposium on Edge Computing (SEC).

[35]  Aleksandrs Slivkins,et al.  Introduction to Multi-Armed Bandits , 2019, Found. Trends Mach. Learn..

[36]  Klara Nahrstedt,et al.  Serdab: An IoT Framework for Partitioning Neural Networks Computation across Multiple Enclaves , 2020, 2020 20th IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing (CCGRID).

[37]  Liang Zheng,et al.  Improving Person Re-identification by Attribute and Identity Learning , 2017, Pattern Recognit..

[38]  Kaiqi Huang,et al.  Pose Guided Deep Model for Pedestrian Attribute Recognition in Surveillance Scenarios , 2018, 2018 IEEE International Conference on Multimedia and Expo (ICME).

[39]  H. T. Kung,et al.  Distributed Deep Neural Networks Over the Cloud, the Edge and End Devices , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS).

[40]  Xiaogang Wang,et al.  HydraPlus-Net: Attentive Deep Features for Pedestrian Analysis , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[41]  Lei Zhang,et al.  Homocentric Hypersphere Feature Embedding for Person Re-Identification , 2019, 2019 IEEE International Conference on Image Processing (ICIP).