Vehicle Segmentation and Classification Using Deformable Templates

This paper proposes a segmentation algorithm using deformable template models to segment a vehicle of interest both from the stationary complex background and other moving vehicles in an image sequence. We define a polygonal template to characterize a general model of a vehicle and derive a prior probability density function to constrain the template to be deformed within a set of allowed shapes. We propose a likelihood probability density function which combines motion information and edge directionality to ensure that the deformable template is contained within the moving areas in the image and its boundary coincides with strong edges with the same orientation in the image. The segmentation problem is reduced to a minimization problem and solved by the Metropolis algorithm. The system was successfully tested on 405 image sequences containing multiple moving vehicles on a highway.

[1]  Yuan-Fang Wang,et al.  Surface Reconstruction Using Deformable Models with Interior and Boundary Constraints , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  M. Cremer,et al.  A new class of dynamic methods for the identification of origin-destination flows , 1987 .

[3]  Kanti V. Mardia,et al.  Deformable templates in image sequences , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems.

[4]  D. M. Keenan,et al.  Towards automated image understanding , 1989 .

[5]  Michael I. Miller,et al.  Multiple target direction of arrival tracking , 1995, IEEE Trans. Signal Process..

[6]  P. G. Michalopoulos,et al.  Vehicle detection video through image processing: the Autoscope system , 1991 .

[7]  U. Grenander,et al.  Structural Image Restoration through Deformable Templates , 1991 .

[8]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[9]  Anil K. Jain,et al.  A modified Hausdorff distance for object matching , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[10]  Sankar K. Pal,et al.  A review on image segmentation techniques , 1993, Pattern Recognit..

[11]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[12]  Anil K. Jain,et al.  Segmentation and matching of moving vehicles from complex outdoor scenes , 1995 .

[13]  Ulf Grenander,et al.  Hands: A Pattern Theoretic Study of Biological Shapes , 1990 .

[14]  Anil K. Jain,et al.  A vision-based vehicle matching system , 1994, Proceedings of the Intelligent Vehicles '94 Symposium.

[15]  Y. Tanaka Travel-time data provision system using vehicle license number recognition devices , 1992, Proceedings of the Intelligent Vehicles `92 Symposium.

[16]  Jitendra Malik,et al.  Towards robust automatic traffic scene analysis in real-time , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[17]  Sridhar Lakshmanan,et al.  Lane detection for automotive sensors , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[18]  Sridhar Lakshmanan,et al.  A Deformable Template Approach to Detecting Straight Edges in Radar Images , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  S. Geman,et al.  Diffusions for global optimizations , 1986 .

[20]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Geir Storvik,et al.  A Bayesian Approach to Dynamic Contours Through Stochastic Sampling and Simulated Annealing , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  A. F. M. Smith,et al.  Dynamic image analysis using Bayesian shape and texture models , 1993 .

[23]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Basilis Gidas,et al.  The Langevin Equation as a Global Minimization Algorithm , 1986 .