Feature Correspondence in Low Quality CCTV Videos

Closed-circuit television cameras are used extensively to monitor streets for the security of the public. Whether passively recording day-to-day life, or actively monitoring a developing situation such as public disorder, the videos recorded have proven invaluable to police forces world wide to trace suspects and victims alike. The volume of video produced from the array of camera covering even a small area is large, and growing in modern society, and post-event analysis of collected video is a time consuming problem for police forces that is increasing. Automated computer vision analysis is desirable, but current systems are unable to reliably process videos from CCTV cameras. The video quality is low, and computer vision algorithms are unable to perform sufficiently to achieve usable results. In this chapter, we describe some of the reasons for the failure of contemporary algorithms and focus on the fundamental task of feature correspondence between frames of video—a well-studied and often considered solved problem in high quality videos, but still a challenge in low quality imagery. We present solutions to some of the problems that we acknowledge, and provide a comprehensive analysis where we demonstrate feature matching using a 138-dimensional descriptor that improves the matching performance of a state-of-the-art 384-dimension colour descriptor with just \(36\,\%\) of the storage requirements.

[1]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[2]  Chong-Wah Ngo,et al.  Towards optimal bag-of-features for object categorization and semantic video retrieval , 2007, CIVR '07.

[3]  Andrew Zisserman,et al.  Object Level Grouping for Video Shots , 2004, International Journal of Computer Vision.

[4]  Huan Liu,et al.  Chi2: feature selection and discretization of numeric attributes , 1995, Proceedings of 7th IEEE International Conference on Tools with Artificial Intelligence.

[5]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Koen E. A. van de Sande,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Jurrien Bijhold,et al.  Tracking people and cars using 3D modeling and CCTV. , 2010, Forensic science international.

[8]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[9]  Anil K. Jain,et al.  ViSE: Visual Search Engine Using Multiple Networked Cameras , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[10]  Bo Zhang,et al.  A Formal Study of Shot Boundary Detection , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Per-Erik Forssén,et al.  Maximally Stable Colour Regions for Recognition and Matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Theo Gevers,et al.  Selection and fusion of color models for feature detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Ebroul Izquierdo,et al.  Robust feature matching in the wild , 2015, 2015 Science and Information Conference (SAI).

[14]  Fiaz Hussain,et al.  Video Indexing: A Survey , 2014 .

[15]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[16]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Cordelia Schmid,et al.  Coloring Local Feature Extraction , 2006, ECCV.

[18]  J. Alison Noble,et al.  Finding Corners , 1988, Alvey Vision Conference.

[19]  C. V. Jawahar,et al.  Word Image Retrieval Using Bag of Visual Words , 2012, 2012 10th IAPR International Workshop on Document Analysis Systems.

[20]  Fredric C. Gey,et al.  The relationship between recall and precision , 1994 .

[21]  Cedric Nishan Canagarajah,et al.  A Unified Framework for Object Retrieval and Mining , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Michael Isard,et al.  Object retrieval with large vocabularies and fast spatial matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  George Hripcsak,et al.  Technical Brief: Agreement, the F-Measure, and Reliability in Information Retrieval , 2005, J. Am. Medical Informatics Assoc..

[24]  Claudio Carpineto,et al.  A Survey of Automatic Query Expansion in Information Retrieval , 2012, CSUR.

[25]  Relja Arandjelovic,et al.  Advancing large scale object retrieval , 2013 .

[26]  Andrew Zisserman,et al.  Efficient Visual Search of Videos Cast as Text Retrieval , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Bernhard Schölkopf,et al.  Learning to Deblur , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[29]  Andrew Zisserman,et al.  Efficient object retrieval from videos , 2004, 2004 12th European Signal Processing Conference.

[30]  David Bordwell The Way Hollywood Tells It: Story and Style in Modern Movies , 2006 .

[31]  Andrew Zisserman,et al.  Three things everyone should know to improve object retrieval , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[33]  Andrew Zisserman,et al.  Video data mining using configurations of viewpoint invariant regions , 2004, CVPR 2004.

[34]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[35]  David G. Lowe,et al.  Shape Descriptors for Maximally Stable Extremal Regions , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[36]  Ebroul Izquierdo,et al.  On the impurity of street-scene video footage , 2015, ICDP.

[37]  Banshidhar Majhi,et al.  Motion blur parameters estimation for image restoration , 2014 .