Single pan and tilt camera indoor positioning and tracking system

An inexpensive single pan and tilt camera based indoor positioning and tracking system is proposed, supported on an architecture where three main modules can be identified: one related to the interface with the camera, tackled with parameter estimation techniques; other, responsible for isolating and identifying the target, based on advanced image processing techniques, and a third, that resorting to nonlinear dynamic system suboptimal state estimation techniques, performs the tracking of the target and estimates its position, and linear and angular velocities. The contributions of this work are fourfold: i) a new indoor positioning and tracking system architecture; ii) a new lens distortion calibration method, that preserves generic straight lines in images; iii) suboptimal nonlinear multiple-model adaptive estimation techniques, for the adopted target model, to tackle the positioning and tracking tasks, and iv) the implementation and validation in real time of a complex tracking system, based on a low cost single camera. To assess the performance of the proposed system, a series of indoor experimental tests for a range of operation of up to ten meter were carried out. An accuracy of 20 cm was obtained under realistic conditions.

[1]  LI X.RONG,et al.  Survey of maneuvering target tracking. Part I. Dynamic models , 2003 .

[2]  X. R. Li,et al.  Survey of maneuvering target tracking. Part I. Dynamic models , 2003 .

[3]  B. Anderson,et al.  Optimal Filtering , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[4]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[5]  A.H. Haddad,et al.  Applied optimal estimation , 1976, Proceedings of the IEEE.

[6]  A. Morse.  Supervisory control of families of linear set-point controllers Part I. Exact matching , 1996, IEEE Trans. Autom. Control..

[7]  Paulo Jorge Ramalho Oliveira,et al.  A Single Pan and Tilt Camera Architecture for Indoor Positioning and Tracking , 2009, VISAPP.

[8]  Olivier D. Faugeras,et al.  Automatic calibration and removal of distortion from scenes of structured environments , 1995, Optics & Photonics.

[9]  Hobart R. Everett,et al.  Where am I?" sensors and methods for mobile robot positioning , 1996 .

[10]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[11]  O. Faugeras,et al.  The Geometry of Multiple Images , 1999 .

[12]  Demetri Terzopoulos,et al.  Deformable models , 2000, The Visual Computer.

[13]  M. Athans,et al.  Adaptive Estimation and Parameter Identification Using Multiple Model Estimation Algorithm , 1976 .

[14]  V. Caselles,et al.  A geometric model for active contours in image processing , 1993 .

[15]  Frederic Fol Leymarie,et al.  Tracking Deformable Objects in the Plane Using an Active Contour Model , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Hellward Broszio,et al.  Robust line-based calibration of lens distortion from a single view , 2003 .

[17]  Demetri Terzopoulos,et al.  A dynamic finite element surface model for segmentation and tracking in multidimensional medical images with application to cardiac 4D image analysis. , 1995, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[18]  Yoram Baram,et al.  Information, consistent estimation and dynamic system identification , 1977 .

[19]  Jerry L. Prince,et al.  Snakes, shapes, and gradient vector flow , 1998, IEEE Trans. Image Process..

[20]  Antonio M. Pascoal,et al.  Issues, progress and new results in robust adaptive control , 2006 .

[21]  Paulo Oliveira,et al.  Single pan and tilt camera indoor positioning and tracking system , 2009, 2009 European Control Conference (ECC).

[22]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[23]  Vincent Lepetit,et al.  Monocular Model-Based 3D Tracking of Rigid Objects: A Survey , 2005, Found. Trends Comput. Graph. Vis..

[24]  D. Magill.  Optimal adaptive estimation of sampled stochastic processes , 1965 .

[25]  Johan Hjelm,et al.  Local Positioning Systems: LBS Applications and Services , 2006 .

[26]  Arthur Gelb,et al.  Applied Optimal Estimation , 1974 .

[27]  Petros G. Voulgaris,et al.  On optimal ℓ∞ to ℓ∞ filtering , 1995, Autom..