Field observation, photosimulation and videosimulation of target detection in maritime environments: update

Laboratory target detection experiments are widely used to assess camouflage techniques for effectiveness in the field. There has been some research to suggest that, in maritime environments, target detection in the laboratory (photosimulation) differs from field observations. This difference suggested that the dynamic nature of real world search tasks, not represented in still images, could be a critical element in field detection. To explore the effect of dynamic elements for inclusion in laboratory experiments, we have initiated a series of studies including videosimulation. In this paper, we extend our previous work, exploring the link between field observations, photosimulation and videosimulation using data obtained at a field trial conducted in Darwin (Australia) with small boat targets. Both laboratory-based experiments (photo- and video-simulation) presented the stimuli on an EIZO colour calibrated monitor, and a Tobii eye tracker was used to record eye movements. Comparing probability of detection (Pd) from the field observations and videosimulation experiment yielded a Pearson correlation coefficient (PCC) of 0.43 and mean absolute error (MAE) of 0.23 from the identity function, whereas comparing the field observations to photosimulation yielded a PCC of 0.45 and MAE 0.20. These new results show the opposite trend to that reported in Culpepper et al 2015. That is, the new results show the laboratory experiments to be mostly easier than the field observations, whereas our 2015 results showed that field observations were easier than photosimulation.

[1]  J. Fleuriet,et al.  Guidelines for Camouflage Assessment Using Observers , 2007 .

[2]  Joanne B. Culpepper,et al.  Methods for measuring time to detect in human observer trials , 2018, Security + Defence.

[3]  G. K. Selj,et al.  Discriminating between camouflaged targets by their time of detection by a human-based observer assessment method , 2015, SPIE Security + Defence.

[4]  Eric Flug,et al.  Infrared sensor modeling for human activity discrimination tasks in urban and maritime environments. , 2009, Applied optics.

[5]  David L. Wilson,et al.  Concepts for search and detection model improvements , 1997, Defense, Security, and Sensing.

[6]  Gerald C. Holst Infrared Imaging Systems: Design, Analysis, Modeling, and Testing VIII , 1991 .

[7]  Joanne B. Culpepper,et al.  Comparison of maritime target detection in field observation, photosimulation and videosimulation , 2020, Security + Defence.

[8]  Joanne B. Culpepper,et al.  A target detection model predicting field observer performance in maritime scenes , 2014, Security and Defence.

[9]  Eric A. Flug Modeling static and dynamic detection of humans in rural terrain , 2014, Defense + Security Symposium.

[10]  Gorm Krogh Selj,et al.  Search by photo methodology for signature properties assessment by human observers , 2015, Defense + Security Symposium.

[11]  Ronald G. Driggers,et al.  Search and detection modeling of military imaging systems , 2013 .

[12]  Joanne B. Culpepper,et al.  A comparison between maritime field observations and photosimulation for developing and validating visible signature evaluation tools , 2015, SPIE Security + Defence.

[13]  Eddie L. Jacobs,et al.  The Targeting Task Performance (TTP) Metric A New Model for Predicting Target Acquisition Performance , 2004 .

[14]  Richard Hecker Camaeleon--camouflage assessment by evaluation of local energy, spatialfrequency, and orientation , 1992, Defense, Security, and Sensing.

[15]  E. Bloomfield Executive summary , 2019, Communication Strategies for Engaging Climate Skeptics.

[16]  Alexander Toet,et al.  Urban camouflage assessment through visual search and computational saliency , 2012 .

[17]  Gorm Krogh Selj,et al.  Evaluation of camouflage pattern performance of textiles by human observers and CAMAELEON , 2017, Security + Defence.

[18]  Piet Bijl,et al.  Target acquisition performance: effects of target aspect angle, dynamic imaging, and signal processing , 2008, SPIE Defense + Commercial Sensing.