CARE: A dynamic stereo vision sensor system for fall detection

This paper presents a recently developed dynamic stereo vision sensor system and its application for fall detection towards safety for elderly at home. The system consists of (1) two optical detector chips with 304×240 event-driven pixels which are only sensitive to relative light intensity changes, (2) an FPGA for interfacing the detectors, early data processing, and stereo matching for depth map reconstruction, (3) a digital signal processor for interpreting the sensor data in real-time for fall recognition, and (4) a wireless communication module for instantly alerting caring institutions. This system was designed for incident detection in private homes of elderly to foster safety and security. The two main advantages of the system, compared to existing wearable systems are from the application's point of view: (a) the stationary installation has a better acceptance for independent living comparing to permanent wearing devices, and (b) the privacy of the system is systematically ensured since the vision detector does not produce real images such as classic video sensors. The system can actually process about 300 kevents per second. It was evaluated using 500 fall cases acquired with a stuntman. More than 90% positive detections were reported. We will show a live demonstration during ISCAS2012 of the sensor system and its capabilities.

[1]  Emanuele Trucco,et al.  Rectification with unconstrained stereo geometry , 1997, BMVC.

[2]  Daniel Matolin,et al.  A QVGA 143 dB Dynamic Range Frame-Free PWM Image Sensor With Lossless Pixel-Level Video Compression and Time-Domain CDS , 2011, IEEE Journal of Solid-State Circuits.

[3]  Martin Litzenberger,et al.  Precision Time-Stamp Generation , 2007 .

[4]  Tobias Delbrück,et al.  Frame-free dynamic digital vision , 2008 .

[5]  Tobi Delbrück,et al.  A 128$\times$ 128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor , 2008, IEEE Journal of Solid-State Circuits.

[6]  Stephan Schraml,et al.  Live demonstration: Dynamic stereo vision system for real-time tracking , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[7]  Stephan Schraml,et al.  Event-driven stereo vision for fall detection , 2011, CVPR 2011 WORKSHOPS.

[8]  Eugenio Culurciello,et al.  Fall detection using an address-event temporal contrast vision sensor , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[9]  Zhan Ma,et al.  Smart Cameras , 2020, Encyclopedia of Biometrics.