InSegtCone: interactive segmentation of crystalline cones in compound eyes

Understanding the diversity of eyes is crucial to unravel how different animals use vision to interact with their respective environments. To date, comparative studies of eye anatomy are scarce because they often involve time-consuming or inefficient methods. X-ray micro-tomography is a promising high-throughput imaging technique that enables to reconstruct the 3D anatomy of eyes, but powerful tools are needed to perform fast conversions of anatomical reconstructions into functional eye models. We developed a computing method named InSegtCone to automatically segment the crystalline cones in the apposition compound eyes of arthropods. Here, we describe the full auto-segmentation process, showcase its application to three different insect compound eyes and evaluate its performance. The auto-segmentation could successfully label the full individual shapes of 60%-80% of the crystalline cones, and is about as accurate and 250 times faster than manual labelling of the individual cones. We believe that InSegtCone can be an important tool for peer scientists to enable extensive comparisons of the diversity of eyes and vision in arthropods.

[1]  Pat Morris Animal Eyes (Oxford Animal Biology Series) – By Michael F. Land & Dan‐Eric Nilsson , 2012 .

[2]  M. Land Visual acuity in insects. , 1997, Annual review of entomology.

[3]  Emily Baird,et al.  X-ray micro computed-tomography , 2017, Current Biology.

[4]  Emily Baird,et al.  Exploring the visual world of fossilized and modern fungus gnat eyes (Diptera: Keroplatidae) with X-ray microtomography , 2020, Journal of the Royal Society Interface.

[5]  Jochen Zeil,et al.  Functional anatomy of the fiddler crab compound eye (Uca vomeris: Ocypodidae, Brachyura, Decapoda) , 2014, The Journal of comparative neurology.

[6]  E. Baird,et al.  Using micro-CT techniques to explore the role of sex and hair in the functional morphology of bumblebee (Bombus terrestris) ocelli , 2019, Vision Research.

[7]  Martin J How,et al.  Light adaptation mechanisms in the eye of the fiddler crab Afruca tangeri , 2020, The Journal of comparative neurology.

[8]  Doekele G. Stavenga,et al.  Pseudopupils of Compound Eyes , 1979 .

[9]  Michael Drakopoulos,et al.  Superior techniques for eliminating ring artifacts in X-ray micro-tomography. , 2018, Optics express.

[10]  M. Butler,et al.  The relationship between microhabitat use, allometry and functional variation in the eyes of Hawaiian Megalagrion damselflies , 2016 .

[11]  Anders Bjorholm Dahl,et al.  Content-based Propagation of User Markings for Interactive Segmentation of Patterned Images , 2018, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[12]  Ali Saleh Alkaladi The functional anatomy of the fiddler crab compound eye , 2008 .

[13]  Almut Kelber,et al.  Visual ecology of Indian carpenter bees II: adaptations of eyes and ocelli to nocturnal and diurnal lifestyles , 2009, Journal of Comparative Physiology A.

[14]  E. Baird,et al.  Bumblebee visual allometry results in locally improved resolution and globally improved sensitivity , 2018, bioRxiv.

[15]  Walter Kaiser,et al.  Visual field size, binocular domain and the ommatidial array of the compound eyes in worker honey bees , 1981, Journal of comparative physiology.

[16]  Ajay Limaye,et al.  Drishti: a volume exploration and presentation tool , 2012, Optics & Photonics - Optical Engineering + Applications.

[17]  Eric J. Warrant,et al.  Form vision in the insect dorsal ocelli: An anatomical and optical analysis of the dragonfly median ocellus , 2007, Vision Research.

[18]  Herbert Baumgärtner,et al.  Der Formensinn und die Sehschärfe der Bienen , 1928, Zeitschrift für vergleichende Physiologie.

[19]  Martin Stevens,et al.  Visual Ecology , 2015 .

[20]  Martin Bergman,et al.  Eye morphology and visual acuity in the pipevine swallowtail (Battus philenor) studied with a new method of measuring interommatidial angles , 2016 .

[21]  Ursula Menzi,et al.  Visual adaptation in nocturnal and diurnal ants , 2004, Journal of Comparative Physiology A.

[22]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[23]  Christoph Rau,et al.  Coherent imaging at the Diamond beamline I13 , 2011 .

[24]  Eric J. Warrant,et al.  Visual Adaptations for Mate Detection in the Male Carpenter Bee Xylocopa tenuiscapa , 2017, PloS one.