Data-Driven Logical Topology Inference for Managing Safety and Re-Identification of Patients Through Multi-Cameras IoT

As Internet of Things (IoT) develops, IoT technologies are starting to integrate intelligent cameras for managing safety within mental health hospital wards and relevant spaces, seeking out specified individuals from these surveillance videos filmed by the various cameras. Because monitoring is one of the important application of IoT based on distributed video cameras. In order to fine-grained re-identification of patients and their activities against the very low resolution, occlusions and pose, viewpoint and illumination changes, we propose a novel data-driven model to infer multi-cameras logical topology and re-identify patients captured by different cameras. In our model, we employ a Time-Delayed Mutual Information (TDMI) model in order to address multi-cameras logical topology inference. Additionally, we use a well-trained Deep Convolutional Neural Network (DCNN) to extract characteristics. Moreover, we employ a name-ability model to discover deep attributes and a classifier based on a structural output of attributes is designed to tackle the re-identification of patients, especially who possess psychiatric behaviour. In order to improve the present model’s performance, we resort to the parallelized implementations. Experimental results show that our model possesses the best performance as compared to state-of-the-art model,especially, when the semantic restrictions are imposed onto the production of patients’ specific attributes with structural output. Further, the deep learning model is used to produce characteristics when there is no supervision on the learning model of attributes.

[1]  Xiaogang Wang,et al.  Unsupervised Salience Learning for Person Re-identification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Lin Wu,et al.  What-and-Where to Match: Deep Spatially Multiplicative Integration Networks for Person Re-identification , 2017, Pattern Recognit..

[3]  Liang Zheng,et al.  Improving Person Re-identification by Attribute and Identity Learning , 2017, Pattern Recognit..

[4]  Samvit Jain,et al.  Scaling Video Analytics Systems to Large Camera Deployments , 2018, HotMobile.

[5]  Sambit Bakshi,et al.  Illumination and scale invariant relevant visual features with hypergraph-based learning for multi-shot person re-identification , 2017, Multimedia Tools and Applications.

[6]  Huchuan Lu,et al.  Pose-Invariant Embedding for Deep Person Re-Identification , 2017, IEEE Transactions on Image Processing.

[7]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Shaogang Gong,et al.  Attributes-Based Re-identification , 2014, Person Re-Identification.

[9]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Michael Blumenstein,et al.  Crowd Counting in Low-Resolution Crowded Scenes Using Region-Based Deep Convolutional Neural Networks , 2019, IEEE Access.

[11]  Wei Wang,et al.  Multilevel triplet deep learning model for person re-identification , 2019, Pattern Recognit. Lett..

[12]  Meng Wang,et al.  3-D PersonVLAD: Learning Deep Global Representations for Video-Based Person Reidentification , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Yi Yang,et al.  A Bottom-Up Clustering Approach to Unsupervised Person Re-Identification , 2019, AAAI.

[14]  Xiaogang Wang,et al.  A discriminative deep model for pedestrian detection with occlusion handling , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Bernt Schiele,et al.  Multi-cue onboard pedestrian detection , 2009, CVPR.

[16]  Ruimao Zhang,et al.  DeepFashion2: A Versatile Benchmark for Detection, Pose Estimation, Segmentation and Re-Identification of Clothing Images , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Shaogang Gong,et al.  Person Re-identification by Attributes , 2012, BMVC.

[18]  Guoping Qiu,et al.  Cross Domain Person Re-Identification With Large Scale Attribute Annotated Datasets , 2019, IEEE Access.

[19]  Shaogang Gong,et al.  Towards Person Identification and Re-identification with Attributes , 2012, ECCV Workshops.

[20]  Wei Jiang,et al.  Bag of Tricks and a Strong Baseline for Deep Person Re-Identification , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[21]  Zhenmin Tang,et al.  Exploiting textual and visual features for image categorization , 2019, Pattern Recognit. Lett..

[22]  Barbara Caputo,et al.  Looking beyond appearances: Synthetic training data for deep CNNs in re-identification , 2017, Comput. Vis. Image Underst..

[23]  Hantao Yao,et al.  Deep Representation Learning With Part Loss for Person Re-Identification , 2017, IEEE Transactions on Image Processing.

[24]  Pandian Vasant,et al.  Smart city is a safe city: information and communication technology–enhanced urban space monitoring and surveillance systems , 2019, Smart Cities: Issues and Challenges.

[25]  Annan Li,et al.  A Temporal Attentive Approach for Video-Based Pedestrian Attribute Recognition , 2019, PRCV.

[26]  Marilyn Wolf,et al.  Distributed Smart Cameras and Distributed Computer Vision , 2013, Handbook of Signal Processing Systems.

[27]  Ziyan Wu,et al.  A Systematic Evaluation and Benchmark for Person Re-Identification: Features, Metrics, and Datasets , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  William Robson Schwartz,et al.  Kernel Cross-View Collaborative Representation based Classification for Person Re-Identification , 2016, J. Vis. Commun. Image Represent..

[29]  Alessandro Perina,et al.  Person re-identification by symmetry-driven accumulation of local features , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  Go Irie,et al.  Attribute Discovery for Person Re-Identification , 2016, MMM.

[31]  Yongdong Zhang,et al.  Dense 3D-Convolutional Neural Network for Person Re-Identification in Videos , 2019, ACM Trans. Multim. Comput. Commun. Appl..

[32]  Xinge You,et al.  Robust face recognition via occlusion dictionary learning , 2014, Pattern Recognit..

[33]  Venkatesh Saligrama,et al.  Zero Shot Detection , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  Patrick J. Flynn,et al.  On Low-Resolution Face Recognition in the Wild: Comparisons and New Techniques , 2018, IEEE Transactions on Information Forensics and Security.

[35]  Xiao-Ping Zhang,et al.  A novel deep model with multi-loss and efficient training for person re-identification , 2019, Neurocomputing.

[36]  Wen Gao,et al.  Attention Driven Person Re-identification , 2018, Pattern Recognit..

[37]  Alessandro Perina,et al.  Person Re-identification Using Robust Brightness Transfer Functions Based on Multiple Detections , 2015, ICIAP.

[38]  Vittorio Murino,et al.  Custom Pictorial Structures for Re-identification , 2011, BMVC.

[39]  Diego Reforgiato Recupero,et al.  Bridging learning analytics and Cognitive Computing for Big Data classification in micro-learning video collections , 2019, Comput. Hum. Behav..

[40]  Yunchao Wei,et al.  Horizontal Pyramid Matching for Person Re-identification , 2018, AAAI.

[41]  Luc Van Gool,et al.  Object Detection and Tracking for Autonomous Navigation in Dynamic Environments , 2010, Int. J. Robotics Res..

[42]  syeda sadiya,et al.  Visual Data Mining , 2017 .

[43]  J. E. Kelley,et al.  The Cutting-Plane Method for Solving Convex Programs , 1960 .

[44]  Hai Tao,et al.  Viewpoint Invariant Pedestrian Recognition with an Ensemble of Localized Features , 2008, ECCV.

[45]  Shaogang Gong,et al.  Unsupervised Person Re-identification by Deep Learning Tracklet Association , 2018, ECCV.

[46]  C. L. Philip Chen,et al.  Robust Nonnegative Patch Alignment for Dimensionality Reduction , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[47]  Bernt Schiele,et al.  What helps where – and why? Semantic relatedness for knowledge transfer , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[48]  Shaogang Gong,et al.  International Journal of Computer Vision (The original publication is available at www.springerlink.com) Time-Delayed Correlation Analysis for Multi-Camera Activity Understanding , 2009 .

[49]  Yongzhao Zhan,et al.  AL‐DDCNN: a distributed crossing semantic gap learning for person re‐identification , 2017, Concurr. Comput. Pract. Exp..

[50]  Xiaoyang Tan,et al.  Sparse representations based attribute learning for flower classification , 2014, Neurocomputing.

[51]  Taghi M. Khoshgoftaar,et al.  Survey on deep learning with class imbalance , 2019, J. Big Data.

[52]  Zhiming Luo,et al.  Invariance Matters: Exemplar Memory for Domain Adaptive Person Re-Identification , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[53]  Maozhen Li,et al.  Data‐driven pedestrian re‐identification based on hierarchical semantic representation , 2018, Concurr. Comput. Pract. Exp..

[54]  Caifeng Shan,et al.  Sensors, vision and networks: From video surveillance to activity recognition and health monitoring , 2019, J. Ambient Intell. Smart Environ..

[55]  Gang Wang,et al.  A Siamese Long Short-Term Memory Architecture for Human Re-identification , 2016, ECCV.

[56]  Kuk-jin Yoon,et al.  Joint Person Re-identification and Camera Network Topology Inference in Multiple Cameras , 2017, Comput. Vis. Image Underst..

[57]  Teh Ying Wah,et al.  Data fusion and multiple classifier systems for human activity detection and health monitoring: Review and open research directions , 2019, Inf. Fusion.

[58]  Dacheng Tao,et al.  Slow Feature Analysis for Human Action Recognition , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[59]  Bo Zhang,et al.  Discriminatively Boosted Image Clustering with Fully Convolutional Auto-Encoders , 2017, Pattern Recognit..

[60]  Haifeng Hu,et al.  Nuclear norm based adapted occlusion dictionary learning for face recognition with occlusion and illumination changes , 2019, Neurocomputing.

[61]  Wei Jiang,et al.  SphereReID: Deep Hypersphere Manifold Embedding for Person Re-Identification , 2018, J. Vis. Commun. Image Represent..