An Agent Based WCET Analysis for Top-View Person Re-Identification

Person re-identification is a challenging task for improving and personalising the shopping experience in an intelligent retail environment. A new Top View Person Re-Identification (TVPR) dataset of 100 persons has been collected and described in a previous work. This work estimates the Worst Case Execution Time (WCET) for the features extraction and classification steps. Such tasks should not exceed the WCET, in order to ensure the effectiveness of the proposed application. In fact, after the features extraction, the classification process is performed by selecting the first passage under the camera for training and using the others as the testing set. Furthermore, a gender classification is exploited for improving retail applications. We tested all feature sets using k-Nearest Neighbors, Support Vector Machine, Decision Tree and Random Forest classifiers. Experimental results prove the effectiveness of the proposed approach, achieving good performance in terms of Precision, Recall and F1-score.

[1]  Emanuele Frontoni,et al.  Robotic platform for deep change detection for rail safety and security , 2017, 2017 European Conference on Mobile Robots (ECMR).

[2]  Horst Bischof,et al.  Relaxed Pairwise Learned Metric for Person Re-identification , 2012, ECCV.

[3]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[4]  Tarak Gandhi,et al.  Panoramic Appearance Map (PAM) for Multi-camera Based Person Re-identification , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[5]  Emanuele Frontoni,et al.  Shopper Analytics: A Customer Activity Recognition System Using a Distributed RGB-D Camera Network , 2014, VAAM@ICPR.

[6]  Alberto Del Bimbo,et al.  Person Re-Identification by Iterative Re-Weighted Sparse Ranking , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Fabio Roli,et al.  Fast person re-identification based on dissimilarity representations , 2012, Pattern Recognit. Lett..

[8]  Pierre Vandergheynst,et al.  Cascade of descriptors to detect and track objects across any network of cameras , 2010, Comput. Vis. Image Underst..

[9]  Vittorio Murino,et al.  SDALF: Modeling Human Appearance with Symmetry-Driven Accumulation of Local Features , 2014, Person Re-Identification.

[10]  Emanuele Frontoni,et al.  Visual and Textual Sentiment Analysis of Brand-Related Social Media Pictures Using Deep Convolutional Neural Networks , 2017, ICIAP.

[11]  Hai Tao,et al.  Viewpoint Invariant Pedestrian Recognition with an Ensemble of Localized Features , 2008, ECCV.

[12]  Rita Cucchiara,et al.  People reidentification in surveillance and forensics , 2013, ACM Comput. Surv..

[13]  Shaogang Gong,et al.  Reidentification by Relative Distance Comparison , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Simone Calderara,et al.  HECOL: Homography and epipolar-based consistent labeling for outdoor park surveillance , 2008, Comput. Vis. Image Underst..

[15]  Alessandro Perina,et al.  Multiple-Shot Person Re-identification by HPE Signature , 2010, 2010 20th International Conference on Pattern Recognition.

[16]  Mubarak Shah,et al.  Modeling inter-camera space-time and appearance relationships for tracking across non-overlapping views , 2008, Comput. Vis. Image Underst..

[17]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[18]  Hichem Snoussi,et al.  Discriminant quaternion local binary pattern embedding for person re-identification through prototype formation and color categorization , 2017, Eng. Appl. Artif. Intell..

[19]  Michael Lindenbaum,et al.  Learning Implicit Transfer for Person Re-identification , 2012, ECCV Workshops.

[20]  Rainer Stiefelhagen,et al.  Interactive person re-identification in TV series , 2010, 2010 International Workshop on Content Based Multimedia Indexing (CBMI).

[21]  Alessandro Perina,et al.  Multiple-shot person re-identification by chromatic and epitomic analyses , 2012, Pattern Recognit. Lett..

[22]  Hai Tao,et al.  Evaluating Appearance Models for Recognition, Reacquisition, and Tracking , 2007 .

[23]  Emanuele Frontoni,et al.  People Detection and Tracking from an RGB-D Camera in Top-View Configuration: Review of Challenges and Applications , 2017, ICIAP Workshops.

[24]  Emanuele Frontoni,et al.  Person Re-identification Dataset with RGB-D Camera in a Top-View Configuration , 2016, VAAM/FFER@ICPR.

[25]  Giorgio C. Buttazzo,et al.  The challenge of real-time multi-agent systems for enabling IoT and CPS , 2017, WI.

[26]  Paolo Sernani,et al.  Exploring the ambient assisted living domain: a systematic review , 2017, J. Ambient Intell. Humaniz. Comput..

[27]  Roberto Pierdicca,et al.  Robust and affordable retail customer profiling by vision and radio beacon sensor fusion , 2016, Pattern Recognit. Lett..

[28]  Alessio Del Bue,et al.  Re-identification with RGB-D Sensors , 2012, ECCV Workshops.

[29]  Shaogang Gong,et al.  Person Re-Identification , 2014 .

[30]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[31]  Horst Bischof,et al.  Large scale metric learning from equivalence constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  David Declercq,et al.  3D facial expression recognition using kernel methods on Riemannian manifold , 2017, Eng. Appl. Artif. Intell..

[33]  Emanuele Frontoni,et al.  Modelling and Forecasting Customer Navigation in Intelligent Retail Environments , 2018, J. Intell. Robotic Syst..

[34]  László Havasi,et al.  Eigenwalks: walk detection and biometrics from symmetry patterns , 2005, IEEE International Conference on Image Processing 2005.

[35]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[36]  Larry S. Davis,et al.  Learning Discriminative Appearance-Based Models Using Partial Least Squares , 2009, 2009 XXII Brazilian Symposium on Computer Graphics and Image Processing.

[37]  Emanuele Frontoni,et al.  Mobile robot for retail surveying and inventory using visual and textual analysis of monocular pictures based on deep learning , 2017, 2017 European Conference on Mobile Robots (ECMR).

[38]  Shaogang Gong,et al.  Person Re-Identification by Support Vector Ranking , 2010, BMVC.

[39]  Aldo Franco Dragoni,et al.  Testing Intelligent Solutions for the Ambient Assisted Living in a Simulator , 2016, PETRA.

[40]  Richard I. Hartley,et al.  Person Reidentification Using Spatiotemporal Appearance , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[41]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[42]  Shaogang Gong,et al.  Person re-identification by probabilistic relative distance comparison , 2011, CVPR 2011.

[43]  Vittorio Murino,et al.  Custom Pictorial Structures for Re-identification , 2011, BMVC.

[44]  Herman Akdag,et al.  Efficient local monitoring approach for the task of background subtraction , 2017, Eng. Appl. Artif. Intell..

[45]  Stefano Messelodi,et al.  Boosting Fisher vector based scoring functions for person re-identification , 2015, Image Vis. Comput..

[46]  Alessandro Perina,et al.  Person re-identification by symmetry-driven accumulation of local features , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[47]  Luc Van Gool,et al.  Depth and Appearance for Mobile Scene Analysis , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[48]  Narendra Ahuja,et al.  Pedestrian Recognition with a Learned Metric , 2010, ACCV.