On the use of the Kinect sensor for human identification in smart environments

This work is framed into the context of ambient intelligence applications, a general definition which usually refers to applications aimed at embedding technology in the environment and enriching it with the capability of recognizing people and adapting itself to user specific needs and preferences. One basic requirement for this kind of applications is unobtrusiveness: user recognition and environment personalization should not be perceived by the user, performed while he/she performs normal daily activities. Biometric recognition is particularly suited for this kind of applications, provided that suitable characteristics are exploited. The aim of this paper is to evaluate, in this application scenario, the possibility of performing automatic person identification using data collected by the Kinect sensor. In particular, starting from a sequence of frames, face and anthropometric measurements are considered for recognition of individuals. Extensive experiments show the feasibility of such technology for ambient intelligence applications.

[1]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[2]  Michael Hayes,et al.  Altitude control of a quadrotor helicopter using depth map from Microsoft Kinect sensor , 2011, 2011 IEEE International Conference on Mechatronics.

[3]  Massimo Tistarelli,et al.  Biometrics at a Distance: Issues, Challenges, and Prospects , 2009, Handbook of Remote Biometrics.

[4]  Erik Hjelmås,et al.  Face Detection: A Survey , 2001, Comput. Vis. Image Underst..

[5]  P.-C.-F. Daunou,et al.  Mémoire sur les élections au scrutin , 1803 .

[6]  James M. Keller,et al.  A system for change detection and human recognition in voxel space using the Microsoft Kinect sensor , 2011, 2011 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[7]  Marjorie Skubic,et al.  Capturing habitual, in-home gait parameter trends using an inexpensive depth camera , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[8]  Ho-Sub Yoon,et al.  Robust Face Recognition Using The Modified Census Transform , 2007, 2007 International Symposium on Communications and Information Technologies.

[9]  Zhang Yong,et al.  Novel Interactive Mode Based on Face-Recognition and Facial Orientation-Estimation Applied to AmI , 2008, 2008 2nd International Conference on Bioinformatics and Biomedical Engineering.

[10]  Yunhong Wang,et al.  A Survey of Advances in Biometric Gait Recognition , 2011, CCBR.

[11]  H. Yasukawa,et al.  Personal identification using footstep detection , 2004, Proceedings of 2004 International Symposium on Intelligent Signal Processing and Communication Systems, 2004. ISPACS 2004..

[12]  Sabah Jassim,et al.  Image-Quality-Based Adaptive Face Recognition , 2010, IEEE Transactions on Instrumentation and Measurement.

[13]  Wei Jia,et al.  Survey of Gait Recognition , 2009, ICIC.

[14]  Paul Wintz,et al.  Digital image processing (2nd ed.) , 1987 .

[15]  Diane J. Cook,et al.  Author's Personal Copy Pervasive and Mobile Computing Ambient Intelligence: Technologies, Applications, and Opportunities , 2022 .

[16]  Peter H. N. de With,et al.  Real-time embedded face recognition for smart home , 2005, IEEE Transactions on Consumer Electronics.

[17]  Jean-Luc Dugelay,et al.  Person recognition using facial video information: A state of the art , 2009, J. Vis. Lang. Comput..

[18]  Claudia Iancu,et al.  Biometric Access Control for Digital Media Streams in Home Networks , 2007, 2007 Digest of Technical Papers International Conference on Consumer Electronics.

[19]  Paulo Fernando Ferreira Rosa,et al.  Identification system for smart homes using footstep sounds , 2010, 2010 IEEE International Symposium on Industrial Electronics.

[20]  Kamin Whitehouse,et al.  Using Height Sensors for Biometric Identification in Multi-resident Homes , 2010, Pervasive.

[21]  Ligang Liu,et al.  Scanning 3D Full Human Bodies Using Kinects , 2012, IEEE Transactions on Visualization and Computer Graphics.

[22]  Venu Govindaraju,et al.  Integrating recognition and reasoning in smart environments , 2008 .

[23]  Toby Sharp,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR.

[24]  Dario Maio,et al.  Incremental template updating for face recognition in home environments , 2010, Pattern Recognit..

[25]  Michael Friedewald,et al.  Perspectives of ambient intelligence in the home environment , 2005 .

[26]  Anil K. Jain,et al.  Soft Biometric Traits for Personal Recognition Systems , 2004, ICBA.

[27]  Alex Pentland,et al.  Face Recognition for Smart Environments , 2000, Computer.

[28]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[29]  Yao-Jen Chang,et al.  A Kinect-based system for physical rehabilitation: a pilot study for young adults with motor disabilities. , 2011, Research in developmental disabilities.

[30]  Venu Govindaraju,et al.  Multimodal identification and tracking in smart environments , 2010, Personal and Ubiquitous Computing.

[31]  Andrea F. Abate,et al.  2D and 3D face recognition: A survey , 2007, Pattern Recognit. Lett..

[32]  Baining Guo,et al.  Kinect Identity: Technology and Experience , 2011, Computer.

[33]  Alphonse Bertillon,et al.  Signaletic instructions including the theory and practice of anthropometrical identification , 2022 .

[34]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[35]  Claudia Linnhoff-Popien,et al.  Gait Recognition with Kinect , 2012 .

[36]  Johannes Stallkamp,et al.  A video-based door monitoring system using local appearance-based face models , 2010, Comput. Vis. Image Underst..

[37]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Gregory D. Abowd,et al.  The smart floor: a mechanism for natural user identification and tracking , 2000, CHI Extended Abstracts.

[39]  Jake K. Aggarwal,et al.  Human detection using depth information by Kinect , 2011, CVPR 2011 WORKSHOPS.