Image segmentation based on motion/luminance integration and oscillatory correlation

An image segmentation method is proposed based on the integration of motion and luminance information. The method is composed of two parallel pathways that process motion and luminance, respectively. Inspired by the visual system, the motion pathway has two stages. The first stage estimates local motion at locations with reliable information The second stage groups locations based on their motion estimates. In the parallel pathway, the input scene is segmented based on luminance. In the subsequent integration stage, motion estimates are refined to obtain the final segmentation result in the motion pathway. For segmentation, LEGION (Locally Excitatory Globally Inhibitory Oscillator Networks) is employed whereby the phases of oscillators are used for region labeling. Results on synthetic and real image sequences are provided.

[1]  Deliang Wang,et al.  Global competition and local cooperation in a network of neural oscillators , 1995 .

[2]  Margaret E. Sereno.  Neural Computation of Pattern Motion: Modeling Stages of Motion Analysis in the Primate Visual Cortex , 1993 .

[3]  Richard I. Ivry,et al.  The perception of transparency with achromatic colors , 1984, Perception & psychophysics.

[4]  T. D. Albright,et al.  Transparency and coherence in human motion perception , 1990, Nature.

[5]  K. Nakayama,et al.  Occlusion and the solution to the aperture problem for motion , 1989, Vision Research.

[6]  DeLiang Wang,et al.  Locally excitatory globally inhibitory oscillator networks , 1995, IEEE Transactions on Neural Networks.

[7]  Michael J. Black,et al.  Estimating Optical Flow in Segmented Images Using Variable-Order Parametric Models With Local Deformations , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Hans Wallach.  Über visuell wahrgenommene Bewegungsrichtung , 1935 .

[9]  John C. Trueswell,et al.  Surface segmentation mechanisms and motion perception , 1993, Vision Research.

[10]  Christoph von der Malsburg,et al.  The Correlation Theory of Brain Function , 1994 .

[11]  W. Reichardt.  Autokorrelations-Auswertung als Funktionsprinzip des Zentralnervensystems , 1957 .

[12]  F Metelli,et al.  The perception of transparency. , 1974, Scientific American.

[13]  J. Gibson,et al.  Motion parallax as a determinant of perceived depth. , 1959, Journal of experimental psychology.

[14]  J. Todd,et al.  On the relative contributions of motion energy and transparency to the perception of moving plaids , 1996, Vision Research.