A low-cost hyperspectral scanner for natural imaging and the study of animal colour vision above and under water

Hyperspectral imaging is a widely used technology for industrial and scientific purposes, but the high cost and large size of commercial setups have made them impractical for most basic research. Here, we designed and implemented a fully open source and low-cost hyperspectral scanner based on a commercial spectrometer coupled to custom optical, mechanical and electronic components. We demonstrate our scanner’s utility for natural imaging in both terrestrial and underwater environments. Our design provides sub-nm spectral resolution between 350–950 nm, including the UV part of the light spectrum which has been mostly absent from commercial solutions and previous natural imaging studies. By comparing the full light spectra from natural scenes to the spectral sensitivity of animals, we show how our system can be used to identify subtle variations in chromatic details detectable by different species. In addition, we have created an open access database for hyperspectral datasets collected from natural scenes in the UK and India. Together with comprehensive online build- and use-instructions, our setup provides an inexpensive and customisable solution to gather and share hyperspectral imaging data.

[1]  Nao Ninomiya,et al.  Visualization is magic! , 2008, J. Vis..

[2]  Guenther Witzany,et al.  Biocommunication of Animals , 2014, Springer Netherlands.

[3]  Gamal ElMasry,et al.  Near-infrared hyperspectral imaging for predicting colour, pH and tenderness of fresh beef , 2012 .

[4]  T Baden,et al.  The Retinal Basis of Vertebrate Color Vision. , 2019, Annual review of vision science.

[5]  Leslie S. Smith,et al.  The principal components of natural images , 1992 .

[6]  C. Hawryshyn,et al.  Visual pigment composition in zebrafish: Evidence for a rhodopsin–porphyropsin interchange system , 2004, Visual Neuroscience.

[7]  Gavin J. Brelstaff,et al.  Hyperspectral camera system: acquisition and analysis , 1995, Remote Sensing.

[8]  G. Buchsbaum,et al.  Trichromacy, opponent colours coding and optimum colour information transmission in the retina , 1983, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[9]  Grigor Sargsyan,et al.  Visualization of invisible reaction zone of H2 molecules on the front of diffusion flame of propane , 2003, J. Vis..

[10]  Shoji Kawamura,et al.  Gene duplication and spectral diversification of cone visual pigments of zebrafish. , 2003, Genetics.

[11]  Gretchen A. Stevens,et al.  A century of trends in adult human height , 2016, eLife.

[12]  M. Webster,et al.  Adaptation and the color statistics of natural images , 1997, Vision Research.

[13]  K. Mullen The contrast sensitivity of human colour vision to red‐green and blue‐yellow chromatic gratings. , 1985, The Journal of physiology.

[14]  Zhuoyi Song,et al.  Microsaccadic sampling of moving image information provides Drosophila hyperacute vision , 2017, bioRxiv.

[15]  Craig E. Williamson,et al.  The attenuation of solar UV radiation in lakes and the role of dissolved organic carbon , 1995 .

[16]  Almut Kelber,et al.  Complementary shifts in photoreceptor spectral tuning unlock the full adaptive potential of ultraviolet vision in birds , 2016, eLife.

[17]  Almut Kelber,et al.  The spatial tuning of achromatic and chromatic vision in budgerigars. , 2011, Journal of vision.

[18]  Y. Kosugi,et al.  Prediction of sweetness and amino acid content in soybean crops from hyperspectral imagery , 2007 .

[19]  D. Foster,et al.  Frequency of metamerism in natural scenes , 2006 .

[20]  Martin Ludvigsen,et al.  Underwater hyperspectral imagery to create biogeochemical maps of seafloor properties , 2013 .

[21]  S. Panzeri,et al.  An inhibitory gate for state transition in cortex , 2017, eLife.

[22]  Oliver Biehlmaier,et al.  Visual acuity in larval zebrafish: behavior and histology , 2010, Frontiers in Zoology.

[23]  Li Zhaoping,et al.  Are cone sensitivities determined by natural color statistics? , 2006, Journal of vision.

[24]  A F Goetz,et al.  Imaging Spectrometry for Earth Remote Sensing , 1985, Science.

[25]  R. Menzel,et al.  The spectral input systems of hymenopteran insects and their receptor-based colour vision , 2004, Journal of Comparative Physiology A.

[26]  Maxime J. Y. Zimmermann,et al.  Zebrafish Differentially Process Color across Visual Space to Match Natural Scenes , 2018, Current Biology.

[27]  S. Poopalasundaram,et al.  Vision in the ultraviolet , 2001, Cellular and Molecular Life Sciences CMLS.

[28]  D. Ruderman,et al.  Estimation of errors in luminance signals encoded by primate retina resulting from sampling of natural images with red and green cones. , 1998, Journal of The Optical Society of America A-optics Image Science and Vision.

[29]  Thomas Euler,et al.  A Tale of Two Retinal Domains: Near-Optimal Sampling of Achromatic Contrasts in Natural Scenes through Asymmetric Photoreceptor Distribution , 2013, Neuron.

[30]  Shoji Kawamura,et al.  Temporal and spatial changes in the expression pattern of multiple red and green subtype opsin genes during zebrafish development , 2005, Journal of Experimental Biology.

[31]  Yukio Kosugi,et al.  Development of a Low-Cost Hyperspectral Whiskbroom Imager Using an Optical Fiber Bundle, a Swing Mirror, and Compact Spectrometers , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[32]  M. G. Nagle,et al.  The tuning of human photopigments may minimize red—green chromatic signals in natural conditions , 1993, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[33]  G. H. Jacobs,et al.  Retinal receptors in rodents maximally sensitive to ultraviolet light , 1991, Nature.

[34]  T W Cronin,et al.  Color signals in natural scenes: characteristics of reflectance spectra and effects of natural illuminants. , 2000, Journal of the Optical Society of America. A, Optics, image science, and vision.

[35]  A. Stockman,et al.  The spectral sensitivities of the middle- and long-wavelength-sensitive cones derived from measurements in observers of known genotype , 2000, Vision Research.

[36]  Ts Troscianko Hyper-spectral camera system: acquisition and analysis , 1995 .

[37]  Colm P. O'Donnell,et al.  Hyperspectral imaging – an emerging process analytical tool for food quality and safety control , 2007 .

[38]  T Troscianko,et al.  Color and luminance information in natural scenes. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[39]  H. Poilvé,et al.  Hyperspectral Imaging and Stress Mapping in Agriculture , 1998 .

[40]  R. Menzel,et al.  Detection of coloured stimuli by honeybees: minimum visual angles and receptor specific contrasts , 1996, Journal of Comparative Physiology A.

[41]  Roger C. Hardie,et al.  Microsaccadic information sampling provides Drosophila hyperacute vision , 2016 .

[42]  Asgeir J. Sørensen,et al.  The use of underwater hyperspectral imaging deployed on remotely operated vehicles - methods and applications , 2016 .

[43]  D. Ruderman,et al.  Statistics of cone responses to natural images: implications for visual coding , 1998 .

[44]  Yukio Kosugi,et al.  Development of a Low-Cost, Lightweight Hyperspectral Imaging System Based on a Polygon Mirror and Compact Spectrometers , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.