Example-Based Color Vehicle Retrieval for Surveillance

In this paper, we evaluate several low dimensionalcolor features for object retrieval in surveillance video.Previous work in object retrieval in surveillance has beenhampered by issues in low resolution, poor segmentation,pose and lighting variations and the cost of retrieval. Toovercome these difficulties, we restrict our analysis toalarm-based vehicle detection and as a consequence, werestrict both pose and lighting variations. In addition, westudy the utility of example-based retrieval to avoid thelimitations of strict color classification. Finally, since weperform our evaluation at run-time for alarm-baseddetection, we do not need to index into a large database.We evaluate the efficiency and effectiveness of severalcolor features including standard color histograms,weighted color histograms, variable bin size colorhistograms and color correlograms. Results show colorcorrelogram to have the best performance for ourdatasets.

[1]  Lisa M. Brown,et al.  Case Study: IBM Smart Surveillance System , 2009 .

[2]  Timo Ojala,et al.  Semantic image retrieval with hsv correlograms , 2001 .

[3]  C. R. Venugopal,et al.  Grouping and Indexing Color Features for Efficient Image Retrieval , 2007 .

[4]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[5]  Joost van de Weijer,et al.  Boosting color saliency in image feature detection , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Lisa M. Brown Color Retrieval for Video Surveillance , 2008, 2008 IEEE Fifth International Conference on Advanced Video and Signal Based Surveillance.

[7]  John R. Smith,et al.  IBM Research TRECVID-2009 Video Retrieval System , 2009, TRECVID.

[8]  Nicu Sebe,et al.  Robust color indexing , 1999, MULTIMEDIA '99.

[9]  B. S. Manjunath,et al.  An efficient color representation for image retrieval , 2001, IEEE Trans. Image Process..

[10]  Shih-Fu Chang,et al.  Columbia University's semantic video search engine 2008 , 2008, CIVR.

[11]  Koen E. A. van de Sande,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Shih-Fu Chang,et al.  Columbia University's semantic video search engine , 2007, CIVR '07.

[13]  Rita Cucchiara,et al.  Color Features Performance Comparison for Image Retrieval , 2009, ICIAP.

[14]  Ramin Zabih,et al.  Histogram refinement for content-based image retrieval , 1996, Proceedings Third IEEE Workshop on Applications of Computer Vision. WACV'96.

[15]  Guoping Qiu,et al.  Visual guided navigation for image retrieval , 2007, Pattern Recognit..

[16]  A. Murat Tekalp,et al.  Robust color histogram descriptors for video segment retrieval and identification , 2002, IEEE Trans. Image Process..

[17]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  James Lee Hafner,et al.  Efficient Color Histogram Indexing for Quadratic Form Distance Functions , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Lei Zhang,et al.  A CBIR method based on color-spatial feature , 1999, Proceedings of IEEE. IEEE Region 10 Conference. TENCON 99. 'Multimedia Technology for Asia-Pacific Information Infrastructure' (Cat. No.99CH37030).