Range imaging technology: new developments and applications for people identification and tracking

Range Imaging (RIM) is a new suitable choice for measurement and modeling in many different applications. RIM is a fusion of two different technologies. According to the terminology, it integrates distance measurement as well as imaging aspects. The distance measurement principle is dominated by the time-of-flight principle while the imaging array (e.g. CMOS sensor) enables each pixel to store also the distance towards the corresponding object point. Due to the technology's relatively new appearance on the market, with a few different realizations, the knowledge of its capabilities is very low. In this paper we present our investigations on the range imaging camera SwissRangerTM (realized by the Swiss Center for Electronics and Microtechnology, CSEM). Different calibration procedures are performed, including a photogrammetric camera calibration and a distance system calibration with respect to the reflectivity and the distance itself. Furthermore we report about measurement applications in the field of surveillance and biometrics. In particular, range imaging data of moving people are analyzed, to identify humans, detect their movements and recover 3D trajectories.

[1]  A. Simoni,et al.  Scannerless 3D imaging sensors , 2005, IEEE International Workshop on Imaging Systems and Techniques, 2005.

[2]  Larry S. Davis,et al.  3-D model-based tracking of humans in action: a multi-view approach , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  David J. Fleet,et al.  Stochastic Tracking of 3 D Human Figures Using 2 D Image Motion , 2000 .

[4]  David J. Fleet,et al.  Stochastic Tracking of 3D Human Figures Using 2D Image Motion , 2000, ECCV.

[5]  Nicola D'Apuzzo.  Surface measurement and tracking of human body parts from multi-image video sequences , 2002 .

[6]  J. M. Rüeger.  Electronic Distance Measurement , 1990 .

[7]  Shoji Kawahito,et al.  A QVGA-size CMOS time-of-flight range image sensor with background light charge draining structure , 2006, Electronic Imaging.

[8]  Timo Kahlmann,et al.  CALIBRATION FOR INCREASED ACCURACY OF THE RANGE IMAGING CAMERA SWISSRANGER , 2006 .

[9]  Michael Lehmann,et al.  An all-solid-state optical range camera for 3 D real-time imaging with sub-centimeter depth resolution ( SwissRanger TM ) , 2005 .

[10]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[11]  Jochen Frey,et al.  Robust 3 D Measurement with PMD Sensors , 2005 .

[12]  Robert Lange,et al.  3D time-of-flight distance measurement with custom solid-state image sensors in CMOS/CCD-technology , 2006 .

[13]  Yaakov Bar-Shalom,et al.  Estimation and Tracking: Principles, Techniques, and Software , 1993 .

[14]  Hilmar Ingensand,et al.  Calibration and improvements of the high-resolution range-imaging camera SwissRanger , 2005 .

[15]  Michael Lehmann,et al.  An all-solid-state optical range camera for 3D real-time imaging with sub-centimeter depth resolution (SwissRanger) , 2004, SPIE Optical Systems Design.

[16]  Esther Koller-Meier,et al.  Extending the condensation algorithm for tracking multiple objects in range image sequences , 2000 .

[17]  E. Charbon,et al.  Arrays of Single Photon Avalanche Diodes in CMOS Technology: Picosecond Timing Resolution for Range Imaging (INVITED) , 2005 .

[18]  S. Burak Gokturk,et al.  A Time-Of-Flight Depth Sensor - System Description, Issues and Solutions , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[19]  Michael O. Kolawole,et al.  Estimation and tracking , 2002 .