The carpet knows: Identifying people in a smart environment from a single step

In this paper, we present an approach for person identification using morphing footsteps measured from a fabric-based pressure mapping sensor system. The flexible fabric sensor is 0.5 mm thin and operates under a 5 mm thick normal carpet; therefore, it can be easily implemented into modern smart living spaces. We extract features concerning single steps with the shifting of gravity center, maximum pressure point and overall pressed area, which are independent from shape details and inter-step relationships of the walking sequences. The system is evaluated with 13 participants wearing shoes and walking normally across the carpet. Overall 529 footsteps are recorded, and the resulting average identification accuracy is 76.9%. Our approach can also be used for further activity recognition with the same physical carpet sensors.

[1]  Kaisa Väänänen,et al.  Evolution towards smart home environments: empirical evaluation of three user interfaces , 2004, Personal and Ubiquitous Computing.

[2]  Paul Lukowicz,et al.  Smart-surface: Large scale textile pressure sensors arrays for activity recognition , 2016, Pervasive Mob. Comput..

[3]  Mark S. Nixon,et al.  Towards automated visual surveillance using gait for identity recognition and tracking across multiple non-intersecting cameras , 2014, Multimedia Tools and Applications.

[4]  Saeid Nahavandi,et al.  A Review of Vision-Based Gait Recognition Methods for Human Identification , 2010, 2010 International Conference on Digital Image Computing: Techniques and Applications.

[5]  C. N. Scanaill,et al.  A Review of Approaches to Mobility Telemonitoring of the Elderly in Their Living Environment , 2006, Annals of Biomedical Engineering.

[6]  Juha Röning,et al.  Gaussian Process Person Identifier Based on Simple Floor Sensors , 2008, EuroSSC.

[7]  Paul Lukowicz,et al.  Smart-mat: recognizing and counting gym exercises with low-cost resistive pressure sensing matrix , 2014, UbiComp.

[8]  Gregory D. Abowd,et al.  The smart floor: a mechanism for natural user identification and tracking , 2000, CHI Extended Abstracts.

[9]  Sergio A. Velastin,et al.  Crowd analysis: a survey , 2008, Machine Vision and Applications.

[10]  Jaeseok Yun,et al.  User Identification Using Gait Patterns on UbiFloorII , 2011, Sensors.

[11]  Nicki Holighaus,et al.  The Large Time-Frequency Analysis Toolbox 2.0 , 2013, CMMR.

[12]  Juha Röning,et al.  TOWARDS THE ADAPTIVE IDENTIFICATION OF WALKERS : AUTOMATED FEATURE SELECTION OF FOOTSTEPS USING DISTINCTION-SENSITIVE LVQ , 2004 .

[13]  Tuan Anh Nguyen,et al.  Energy intelligent buildings based on user activity: A survey , 2013 .

[14]  Paul Lukowicz,et al.  From Smart Clothing to Smart Table Cloth: Design and Implementation of a Large Scale, Textile Pressure Matrix Sensor , 2014, ARCS.

[15]  Gang Qian,et al.  People Identification Using Gait Via Floor Pressure Sensing and Analysis , 2008, EuroSSC.

[16]  Juha Röning,et al.  Combining classifiers with different footstep feature sets and multiple samples for person identification , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[17]  Tingting Mu,et al.  Gait recognition: highly unique dynamic plantar pressure patterns among 104 individuals , 2012, Journal of The Royal Society Interface.

[18]  Juha Röning,et al.  Methods for person identification on a pressure-sensitive floor: Experiments with multiple classifiers and reject option , 2008, Inf. Fusion.

[19]  Bernhard Fröba,et al.  SESAM: A Biometric Person Identification System Using Sensor Fusion , 1997, AVBPA.

[20]  Paul Lukowicz,et al.  Human tracking and identification using a sensitive floor and wearable accelerometers , 2013, 2013 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[21]  Manuel J. Marín-Jiménez,et al.  Automatic Learning of Gait Signatures for People Identification , 2016, IWANN.

[22]  Rita Yi Man Li,et al.  The Usage of Automation System in Smart Home to Provide a Sustainable Indoor Environment: A Content Analysis in Web 1.0 , 2013 .

[23]  Fulvio Corno,et al.  Intelligent Energy Optimization for User Intelligible Goals in Smart Home Environments , 2012, IEEE Transactions on Smart Grid.

[24]  Kanya Tanaka,et al.  Footprint-based personal recognition , 2000, IEEE Transactions on Biomedical Engineering.

[25]  I. Daubechies.  Ten Lectures on Wavelets , 1992 .

[26]  Roberto Brunelli,et al.  Person identification using multiple cues , 1995, IEEE Transactions on Pattern Analysis and Machine Intelligence.