Recursive neural networks for object detection

In this paper, a new recursive neural network model, able to process directed acyclic graphs with labeled edges, is introduced, in order to address the problem of object detection in images. In fact, the detection is a preliminary step in any object recognition system. The proposed method assumes a graph-based representation of images, that combines both spatial and visual features. In particular, after segmentation, an edge between two nodes stands for the adjacency relationship of two homogeneous regions, the edge label collects information on their relative positions, whereas node labels contain visual and geometric information on each region (area, color, texture, etc.). Such graphs are then processed by the recursive model in order to determine the eventual presence and the position of objects inside the image. Some experiments on face detection, carried out on scenes acquired by an indoor camera, are reported, showing very promising results. The proposed technique is general and can be applied in different object detection systems, since it does not include any a priori knowledge on the particular problem.

[1]  Franco Scarselli,et al.  Recursive processing of cyclic graphs , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[2]  Pietro Perona,et al.  Probabilistic affine invariants for recognition , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[3]  Alessandro Sperduti,et al.  Supervised neural networks for the classification of structures , 1997, IEEE Trans. Neural Networks.

[4]  Alex Pentland,et al.  Probabilistic Visual Learning for Object Representation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Franco Scarselli,et al.  BackPropagation through Cyclic Structures , 2003, AI*IA.

[6]  Marco Gori,et al.  A recursive neural network model for processing directed acyclic graphs with labeled edges , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[7]  Takeo Kanade,et al.  A statistical method for 3D object detection applied to faces and cars , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[8]  Franco Scarselli,et al.  Processing directed acyclic graphs with recursive neural networks , 2001, IEEE Trans. Neural Networks.

[9]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Shaogang Gong,et al.  Tracking colour objects using adaptive mixture models , 1999, Image Vis. Comput..

[11]  Franco Scarselli,et al.  Recursive neural networks for processing graphs with labelled edges: theory and applications , 2005, Neural Networks.

[12]  Alessandro Sperduti,et al.  A general framework for adaptive processing of data structures , 1998, IEEE Trans. Neural Networks.

[13]  Christoph Goller,et al.  Inductive Learning in Symbolic Domains Using Structure-Driven Recurrent Neural Networks , 1996, KI.

[14]  Franco Scarselli,et al.  Face Spotting in Color Images using Recursive Neural Networks , 2003 .

[15]  Ying Dai,et al.  Extraction of Facial Images from the Complex Background Using Color Information and SGLD Matrices , 1996 .

[16]  Tomaso A. Poggio,et al.  A general framework for object detection , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).