Multi Person Identification and Localization in Pervasive Assistive Environments

Tracking the location of a user is considered to be the most fundamental step for creating a context aware application such as activity monitoring in an assistive environment. The problem becomes very challenging, if the number of people involved in the scenario is larger than one. The reason is that any multi-person environment such as a hospital demands a simultaneous identification and localization mechanism, thus making the system extremely complex. In this paper, we present a novel, less-intrusive system that uses RFID and a Kinect sensor deployed at various locations of an assistive apartment to continuously track and identify every person in a multi-person assistive environment. The system maps the identification events from the RFID to the location information from the Kinect sensor using two approaches: 1) proximity-based and 2) classification-based. We evaluate our system for both approaches in a real world scenario. Our result shows great prospect of using the RFID and Kinect sensors jointly to solve the simultaneous tracking and identification problem.

[1]  J. Krumm,et al.  Multi-camera multi-person tracking for EasyLiving , 2000, Proceedings Third IEEE International Workshop on Visual Surveillance.

[2]  Wolfram Burgard,et al.  Modeling RFID signal strength and tag detection for localization and mapping , 2009, 2009 IEEE International Conference on Robotics and Automation.

[3]  Luc Van Gool,et al.  Coupled Object Detection and Tracking from Static Cameras and Moving Vehicles , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Wolfram Burgard,et al.  Mapping and localization with RFID technology , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[5]  M. Bouet,et al.  RFID tags: Positioning principles and localization techniques , 2008, 2008 1st IFIP Wireless Days.

[6]  Ramakant Nevatia,et al.  Detection and Tracking of Multiple, Partially Occluded Humans by Bayesian Combination of Edgelet based Part Detectors , 2007, International Journal of Computer Vision.

[7]  Jordi Luque,et al.  Multimodal identification and localization of users in a smart environment , 2008, Journal on Multimodal User Interfaces.

[8]  James Brusey,et al.  Reasoning about uncertainty in location identification with auto-ID , 2003 .

[9]  Stefan Roth,et al.  People-tracking-by-detection and people-detection-by-tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Rita Cucchiara,et al.  Mutual calibration of camera motes and RFIDs for people localization and identification , 2010, ICDSC '10.

[11]  Rainer Stiefelhagen,et al.  Audio-visual multi-person tracking and identification for smart environments , 2007, ACM Multimedia.

[12]  H. Aghajan,et al.  Utilizing RFID Signaling Scheme for Localization of Stationary Objects and Speed Estimation of Mobile Objects , 2007, 2007 IEEE International Conference on RFID.

[13]  Alex Park,et al.  Multimodal Face and Speaker Identification for Mobile Devices , 2007 .

[14]  Luc Van Gool,et al.  Robust Multiperson Tracking from a Mobile Platform , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Theodore S. Rappaport,et al.  Wireless communications - principles and practice , 1996 .

[16]  Klaus Finkenzeller,et al.  Book Reviews: RFID Handbook: Fundamentals and Applications in Contactless Smart Cards and Identification, 2nd ed. , 2004, ACM Queue.

[17]  Ralph Gross,et al.  Person identification using automatic integration of speech, lip, and face experts , 2003, WBMA '03.

[18]  Qin Jin,et al.  Multi-modal Person Identification in a Smart Environment , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Ramakant Nevatia,et al.  How does person identity recognition help multi-person tracking? , 2011, CVPR 2011.

[20]  Dariu Gavrila,et al.  Multi-cue Pedestrian Detection and Tracking from a Moving Vehicle , 2007, International Journal of Computer Vision.

[21]  Andreas Savvides,et al.  Tasking networked CCTV cameras and mobile phones to identify and localize multiple people , 2010, UbiComp.

[22]  P. C. Jain,et al.  RFID and Wireless Sensor Networks , 2010 .

[23]  Yunhao Liu,et al.  LANDMARC: Indoor Location Sensing Using Active RFID , 2004, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003)..

[24]  Rong Yan,et al.  People Identification with Limited Labels in Privacy-Protected Video , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[25]  Tim Wark,et al.  A Wireless Sensor Network for Real-Time Indoor Localisation and Motion Monitoring , 2008, 2008 International Conference on Information Processing in Sensor Networks (ipsn 2008).

[26]  Ann Ferriter,et al.  Radiofrequency identification technology in health care: benefits and potential risks. , 2007, JAMA.

[27]  Mohan M. Trivedi,et al.  Dynamic context capture and distributed video arrays for intelligent spaces , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[28]  Rainer Stiefelhagen,et al.  Towards vision-based 3-D people tracking in a smart room , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[29]  Bastian Leibe,et al.  Multi-person Tracking with Sparse Detection and Continuous Segmentation , 2010, ECCV.