Object Recognition in Flight: How Do Bees Distinguish between 3D Shapes?

Honeybees (Apis mellifera) discriminate multiple object features such as colour, pattern and 2D shape, but it remains unknown whether and how bees recover three-dimensional shape. Here we show that bees can recognize objects by their three-dimensional form, whereby they employ an active strategy to uncover the depth profiles. We trained individual, free flying honeybees to collect sugar water from small three-dimensional objects made of styrofoam (sphere, cylinder, cuboids) or folded paper (convex, concave, planar) and found that bees can easily discriminate between these stimuli. We also tested possible strategies employed by the bees to uncover the depth profiles. For the card stimuli, we excluded overall shape and pictorial features (shading, texture gradients) as cues for discrimination. Lacking sufficient stereo vision, bees are known to use speed gradients in optic flow to detect edges; could the bees apply this strategy also to recover the fine details of a surface depth profile? Analysing the bees’ flight tracks in front of the stimuli revealed specific combinations of flight maneuvers (lateral translations in combination with yaw rotations), which are particularly suitable to extract depth cues from motion parallax. We modelled the generated optic flow and found characteristic patterns of angular displacement corresponding to the depth profiles of our stimuli: optic flow patterns from pure translations successfully recovered depth relations from the magnitude of angular displacements, additional rotation provided robust depth information based on the direction of the displacements; thus, the bees flight maneuvers may reflect an optimized visuo-motor strategy to extract depth structure from motion signals. The robustness and simplicity of this strategy offers an efficient solution for 3D-object-recognition without stereo vision, and could be employed by other flying insects, or mobile robots.

[1]  K. Frisch Der Farbensinn und Formensinn der Biene , 1914 .

[2]  L. Kathariner Das Sehen der Insekten , 2022 .

[3]  J. Gibson,et al.  Motion parallax as a determinant of perceived depth. , 1959, Journal of experimental psychology.

[4]  R. Wehner Pattern Recognition in Bees , 1967, Nature.

[5]  Alun M. Anderson Shape perception in the honey bee , 1977, Animal Behaviour.

[6]  J. L. Gould Pattern learning by honey bees , 1986, Animal Behaviour.

[7]  M. Srinivasan,et al.  Motion cues provide the bee's visual world with a third dimension , 1988, Nature.

[8]  R. Menzel,et al.  Color constancy in the honeybee , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  M. Srinivasan,et al.  Visual figure–ground discrimination in the honeybee: the role of motion parallax at boundaries , 1990, Proceedings of the Royal Society of London. B. Biological Sciences.

[10]  L. Goodman,et al.  The Behaviour and physiology of bees , 1991 .

[11]  T. Collett,et al.  Convergent processing in honeybee vision: multiple channels for the recognition of shape. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[12]  Zeil,et al.  Structure and function of learning flights in ground-nesting bees and wasps , 1996, The Journal of experimental biology.

[13]  R. Menzel,et al.  Symmetry perception in an insect , 1996, Nature.

[14]  M. Lehrer,et al.  Small-scale navigation in the honeybee: active acquisition of visual information about the goal , 1996, The Journal of experimental biology.

[15]  J. Zeil,et al.  Structure and function of learning flights in bees and wasps , 1996 .

[16]  T. Collett,et al.  Flights of Learning , 1996 .

[17]  M. Srinivasan Insects as Gibsonian Animals , 1998 .

[18]  Marion A. Eppler,et al.  Development of Visually Guided Locomotion , 1998 .

[19]  Heinrich H Bülthoff,et al.  Image-based object recognition in man, monkey and machine , 1998, Cognition.

[20]  J. Zeil,et al.  Active vision in insects: an analysis of object-directed zig-zag flights in wasps (Odynerus spinipes , Eumenidae) , 1998, Journal of Comparative Physiology A.

[21]  B Ronacher,et al.  Evidence against a retinotopic-template matching in honeybees’ pattern recognition , 2000, Vision Research.

[22]  Tomaso Poggio,et al.  Models of object recognition , 2000, Nature Neuroscience.

[23]  R. Menzel,et al.  Cognitive architecture of a mini-brain: the honeybee , 2001, Trends in Cognitive Sciences.

[24]  M. Lehrer,et al.  Discrimination of closed shapes by two species of bee, Apis mellifera and Megachile rotundata. , 2002, The Journal of experimental biology.

[25]  M. Srinivasan,et al.  Global perception in small brains: Topological pattern recognition in honey bees , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[26]  Bernhard Schnetter Visuelle Formunterscheidung der Honigbiene im Bereich von Vier- und Sechsstrahlsternen , 1968, Zeitschrift für vergleichende Physiologie.

[27]  M. Lehrer Why do bees turn back and look? , 1993, Journal of Comparative Physiology A.

[28]  M. Srinivasan,et al.  Visual motor computations in insects. , 2004, Annual review of neuroscience.

[29]  Martin Giurfa,et al.  Local-feature assembling in visual pattern recognition and generalization in honeybees , 2004, Nature.

[30]  M. Hertz Die Organisation des optischen Feldes bei der Biene. I. , 2004, Zeitschrift für vergleichende Physiologie.

[31]  J. Zeil Orientation flights of solitary wasps (Cerceris; Sphecidae; Hymenoptera) , 1993, Journal of Comparative Physiology A.

[32]  M. Lehrer,et al.  Generalization of convex shapes by bees: what are shapes made of? , 2005, Journal of Experimental Biology.

[33]  M. Srinivasan Honeybee Vision: In Good Shape for Shape Recognition , 2006, Current Biology.

[34]  Nicolas Franceschini,et al.  A bee in the corridor: centering and wall-following , 2008, Naturwissenschaften.

[35]  L. Chittka,et al.  Bees use three-dimensional information to improve target detection , 2010, Naturwissenschaften.

[36]  M. Srinivasan Honey bees as a model for vision, perception, and cognition. , 2010, Annual review of entomology.

[37]  B. Ronacher Influence of Unrewarded Stimuli on the Classification of Visual Patterns by Honey Bees , 2010 .

[38]  M. Srinivasan,et al.  The moment before touchdown: landing manoeuvres of the honeybee Apis mellifera , 2010, Journal of Experimental Biology.

[39]  Martin Egelhaaf,et al.  Goal seeking in honeybees: matching of optic flow snapshots? , 2010, Journal of Experimental Biology.

[40]  M. Giurfa,et al.  Visual cognition in social insects. , 2011, Annual review of entomology.

[41]  Mandyam V Srinivasan,et al.  Honeybees as a model for the study of visually guided flight, navigation, and biologically inspired robotics. , 2011, Physiological reviews.

[42]  최은진 Studium Generale의 소멸 , 2012 .

[43]  Norbert Boeddeker,et al.  A universal strategy for visually guided landing , 2013, Proceedings of the National Academy of Sciences.

[44]  David D. Lent,et al.  Visual Scene Perception in Navigating Wood Ants , 2013, Current Biology.

[45]  P. Skorupski,et al.  Colour constancy in insects , 2014, Journal of Comparative Physiology A.