A Biologically Inspired Smart Camera for Use in Surveillance Applications

Biological vision systems are capable of discerning detail as well as detecting objects and motion in a wide range of highly variable lighting conditions that proves challenging to traditional cameras. In this paper, the authors describe the real-time implementation of a biological vision model using a high dynamic range video camera and a General Purpose Graphics Processing Unit. The effectiveness of this implementation is demonstrated in two surveillance applications: dynamic equalization of contrast for improved recognition of scene detail and the use of biologically-inspired motion processing for the detection of small or distant moving objects in a complex scene. A system based on this prototype could improve surveillance capability in any number of difficult situations. attracted substantial attention from scientists and engineers. One such challenge is discerning detail in scenes with widely varying lighting levels, given that typically only 8-bit (256 level) luminance is usually available in digital imaging despite the huge range of possible luminance levels that natural lighting conditions provide (range in the order of 108) (Brinkworth, Mah, & O’Carroll, 2007). This presents itself as a limitation on the information content, by which we mean, specifically, the ability to distinguish objects within a scene under difficult lighting conditions. Many conventional camera systems tend to have poor DOI: 10.4018/jdcf.2010070101 2 International Journal of Digital Crime and Forensics, 2(3), 1-14, July-September 2010 Copyright © 2010, IGI Global. Copying or distributing in print or electronic forms without written permission of IGI Global is prohibited. performance when capturing images of scenes with complex lighting conditions. As illustrated in Figure 1 traditional camera systems tend to either struggle to capture details in the darkest or brightest parts of the scene, and occasionally in both. The reason for this is that these conventional cameras generally use a relatively simple global adjustment to the luminance on each frame as a whole, in an attempt to improve the final image output quality. However, in some cases the resulting image quality is poor due to a compromise needing to be reached between information in the bright and dark areas. High dynamic range (HDR) imaging processes allow capture over a much larger luminance range than traditional low dynamic range (LDR or 8-bit), however such images are not supported by the majority of image display and storage media (Seetzen et al., 2004). There are conventional engineering solutions, such as gamma correction and tone mapping (Pattanaik & Yee, 2002; Reinhard, Stark, Shirley, & Ferwerda, 2002), however they tend to be focused on maintaining the psychophysical look of an image to a human observer rather than maximising the information contained within the scene. There are also custom CMOS sensors (Pixim, 2006) that approach the problem differently. By using a different integration time (shutter speed) for every pixel in the image they compress the image before it leaves the camera. This means it is possible to capture information from both the dark and light parts of a scene in a low dynamic range format that is more suitable for transmission, storage and display. While this approach can result in an improvement in the information content in a captured scene it is only part of the solution that exists in biology. Here we consider a biologically-inspired approach based on photoreceptor cells, whose purpose is precisely luminance range compression (Laughlin & Weckstrom, 1993) while maintaining information content. As with the custom sensors by Pixim the integration time of each receptor in biological eyes does change (Payne & Howard, 1981) independently of the global illumination (Matic & Laughlin, 1981); a large number of cascaded non-linear adaptive processes also occur in order to maximise the information content and reduce the bandwidth of the signal (de Ruyter van Steveninck & Laughlin, 1996; Laughlin, de Ruyter van Steveninck, & Anderson, 1998). Figure 1. Images captured with a conventional camera using different exposure settings and global gain adjustments. Left) short exposure time which lets the bright background be seen but misses the darker foreground. Right) long exposure time which over-exposes the background saturating it and resulting in a loss of information, however more foreground detail is present. Traditionally camera operators had to decide which one of these modes they would operate in due to the limitations of the image capturing and processing technology. 12 more pages are available in the full version of this document, which may be purchased using the "Add to Cart" button on the publisher's webpage: www.igi-global.com/article/biologically-inspired-smart-