Visual Person Searches for Retail Loss Detection: Application and Evaluation

We describe a novel computer-vision based system for facilitating the search for people across multiple non-overlapping cameras. The system has been applied in a retail environment for a variety of problems, most specifically for returns fraud prevention. The system detects and tracks people in multiple cameras and enables rapid cross-camera association of tracks. We have created a human-centred application wherein machine-detected events are browsed and associated in a web-based user interface by a loss-prevention specialist. The system has been tested in a real store environment and we develop a variety of performance measures for the task and present results with a breakdown of error types.

[1]  Myron Flickner,et al.  Detection and tracking of shopping groups in stores , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[2]  Sharathchandra U. Pankanti,et al.  Footprints: An IR approach to human detection and tracking , 2001 .

[3]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[4]  David Beymer,et al.  Ghost/sup 3D/: detecting body posture and parts using stereo , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[5]  Chris Stauffer,et al.  Automated multi-camera planar tracking correspondence modeling , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[6]  D. Makris Learning a Multi-camera Topology , 2003 .

[7]  Sharath Pankanti,et al.  Detection and tracking in the IBM PeopleVision system , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[8]  Harpreet S. Sawhney,et al.  Vehicle identification between non-overlapping cameras without direct feature matching , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[9]  Mubarak Shah,et al.  Appearance modeling for tracking in multiple non-overlapping cameras , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Sharath Pankanti,et al.  Appearance models for occlusion handling , 2006, Image Vis. Comput..