Neuroimaging Findings on Amodal Completion: A Review

Amodal completion is the phenomenon of perceiving completed objects even though physically they are partially occluded. In this review, we provide an extensive overview of the results obtained from a variety of neuroimaging studies on the neural correlates of amodal completion. We discuss whether low-level and high-level cortical areas are implicated in amodal completion; provide an overview of how amodal completion unfolds over time while dissociating feedforward, recurrent, and feedback processes; and discuss how amodal completion is represented at the neuronal level. The involvement of low-level visual areas such as V1 and V2 is not yet clear, while several high-level structures such as the lateral occipital complex and fusiform face area seem invariant to occlusion of objects and faces, respectively, and several motor areas seem to code for object permanence. The variety of results on the timing of amodal completion hints to a mixture of feedforward, recurrent, and feedback processes. We discuss whether the invisible parts of the occluded object are represented as if they were visible, contrary to a high-level representation. While plenty of questions on amodal completion remain, this review presents an overview of the neuroimaging findings reported to date, summarizes several insights from computational models, and connects research of other perceptual completion processes such as modal completion. In all, it is suggested that amodal completion is the solution to deal with various types of incomplete retinal information, and highly depends on stimulus complexity and saliency, and therefore also give rise to a variety of observed neural patterns.

[1]  Gijs Plomp,et al.  Asymmetric priming effects in visual processing of occlusion patterns , 2006, Perception & psychophysics.

[2]  R. von der Heydt,et al.  Mechanisms of contour perception in monkey visual cortex. II. Contours bridging gaps , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[3]  N Bruno,et al.  Amodal completion of partly occluded surfaces: is there a mosaic stage? , 1997, Journal of experimental psychology. Human perception and performance.

[4]  S. J. Hazenberg,et al.  Disentangling effects of structure and knowledge in perceiving partly occluded shapes: An ERP study , 2016, Vision Research.

[5]  P. Skudlarski,et al.  Neuronal representation of occluded objects in the human brain , 2004, Neuropsychologia.

[6]  Lars Muckli,et al.  Separate cortical stages in amodal completion revealed by functional magnetic resonance adaptation , 2007, BMC Neuroscience.

[7]  Lars Muckli,et al.  Cortical feedback to V1 and V2 contains unique information about high-level scene structure , 2016, bioRxiv.

[8]  Scott P. Johnson,et al.  Systems in development: motor skill acquisition facilitates three-dimensional object completion. , 2010, Developmental psychology.

[9]  A. Fyall,et al.  The Role of Visual Area V4 in the Discrimination of Partially Occluded Shapes , 2014, The Journal of Neuroscience.

[10]  Nikolaus Kriegeskorte,et al.  Recurrent Convolutional Neural Networks: A Better Model of Biological Object Recognition , 2017, bioRxiv.

[11]  Peter A van der Helm Bayesian confusions surrounding simplicity and likelihood in perceptual organization. , 2011, Acta psychologica.

[12]  R. Baillargeon Object permanence in 3½- and 4½-month-old infants. , 1987 .

[13]  Wael El-Deredy,et al.  Tracking visible and occluded targets: Changes in event related potentials during motion extrapolation , 2009, Neuropsychologia.

[14]  Hossein Mobahi,et al.  Face recognition with contiguous occlusion using markov random fields , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[15]  E. Leeuwenberg A perceptual coding language for visual and auditory patterns. , 1971, The American journal of psychology.

[16]  Marcel A J van Gerven,et al.  Vividness of Visual Imagery Depends on the Neural Overlap with Perception in Visual Areas , 2017, The Journal of Neuroscience.

[17]  R. von der Heydt,et al.  Coding of Border Ownership in Monkey Visual Cortex , 2000, The Journal of Neuroscience.

[18]  Clayton E. Curtis,et al.  Neural Substrates of Dynamic Object Occlusion , 2007, Journal of Cognitive Neuroscience.

[19]  J. Wagemans,et al.  Conjuring Deceptions: Fooling the Eye or Fooling the Mind? , 2016, Trends in Cognitive Sciences.

[20]  P. Kellman,et al.  A theory of visual interpolation in object perception , 1991, Cognitive Psychology.

[21]  Fraser W. Smith,et al.  Nonstimulated early visual areas carry information about surrounding context , 2010, Proceedings of the National Academy of Sciences.

[22]  Rüdiger von der Heydt,et al.  Simulation of neural contour mechanisms: representing anomalous contours , 1998, Image Vis. Comput..

[23]  Kunihiko Fukushima,et al.  Neocognitron: A Self-Organizing Neural Network Model for a Mechanism of Visual Pattern Recognition , 1982 .

[24]  R van Lier,et al.  Integrating Global and Local Aspects of Visual Occlusion , 1994, Perception.

[25]  M S Graziano,et al.  Coding the locations of objects in the dark. , 1997, Science.

[26]  S Shimojo,et al.  The Theory of the Curvature-Constraint Line for Amodal Completion , 1995, Perception.

[27]  Z Kourtzi,et al.  Representation of Perceived Object Shape by the Human Lateral Occipital Complex , 2001, Science.

[28]  Taosheng Liu,et al.  Temporally Unfolding Neural Representation of Pictorial Occlusion , 2006, Psychological science.

[29]  T. Hendler,et al.  Object-completion effects in the human lateral occipital complex. , 2002, Cerebral cortex.

[30]  J. Bakin,et al.  Visual Responses in Monkey Areas V1 and V2 to Three-Dimensional Surface Configurations , 2000, The Journal of Neuroscience.

[31]  A. A. Ioannides,et al.  Neural correlates of priming on occluded figure interpretation in human fusiform cortex , 2006, Neuroscience.

[32]  G. Orban,et al.  Selectivity of macaque inferior temporal neurons for partially occluded shapes , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[33]  Robert Oostenveld,et al.  Cortical responses to contextual influences in amodal completion , 2006, NeuroImage.

[34]  Stephen E. Palmer,et al.  Perception of partly occluded objects: A microgenetic analysis. , 1992 .

[35]  Eric T. Shea-Brown,et al.  Dynamic representation of partially occluded objects in primate prefrontal and visual cortex , 2017, eLife.

[36]  Yihong Gong,et al.  Robust Deep Auto-encoder for Occluded Face Recognition , 2015, ACM Multimedia.

[37]  Tim Curran,et al.  The Limits of Feedforward Vision: Recurrent Processing Promotes Robust Object Recognition when Objects Are Degraded , 2012, Journal of Cognitive Neuroscience.

[38]  P. Kellman,et al.  Interpolation processes in object perception: reply to Anderson (2007). , 2007, Psychological review.

[39]  E. Spelke,et al.  Perception of partly occluded objects in infancy , 1983, Cognitive Psychology.

[40]  Simon J Hazenberg,et al.  Differential familiarity effects in amodal completion: support from behavioral and electrophysiological measurements. , 2014, Journal of experimental psychology. Human perception and performance.

[41]  E. Leeuwenberg,et al.  Competing global and local completions in visual occlusion. , 1995, Journal of experimental psychology. Human perception and performance.

[42]  Sven Vrins,et al.  Form Perception of Partly Occluded Shapes in 4‐Month‐Old Infants , 2008 .

[43]  E. Leeuwenberg,et al.  Multiple Completions Primed by Occlusion Patterns , 1995, Perception.

[44]  J. Hegdé,et al.  Preferential responses to occluded objects in the human visual cortex. , 2008, Journal of vision.

[45]  Geoffrey E. Hinton,et al.  Robust Boltzmann Machines for recognition and denoising , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[46]  Rafael Malach,et al.  Rapid completion effects in human high-order visual areas , 2004, NeuroImage.

[47]  Enhong Chen,et al.  Image Denoising and Inpainting with Deep Neural Networks , 2012, NIPS.

[48]  N. Kanwisher,et al.  The lateral occipital complex and its role in object recognition , 2001, Vision Research.

[49]  G. Kanizsa Seeing and thinking. , 1985, Acta psychologica.

[50]  Karl F. Stock,et al.  A COMPUTATIONAL MODEL , 2011 .

[51]  David J. Jilk,et al.  Recurrent Processing during Object Recognition , 2011, Front. Psychol..

[52]  D. Schwarzkopf,et al.  Spatially selective responses to Kanizsa and occlusion stimuli in human visual cortex , 2018, Scientific Reports.

[53]  W. PEDDIE,et al.  Helmholtz's Treatise on Physiological Optics , 1926, Nature.

[54]  Rob van Lier,et al.  Bricks, Butter, and Slices of Cucumber: Investigating Semantic Influences in Amodal Completion , 2009, Perception.

[55]  H. von Helmholtz,et al.  Helmholtz's treatise on physiological optics, Vol. 1, Trans. from the 3rd German ed. , 1924 .

[56]  Yoichi Sugita,et al.  Grouping of image fragments in primary visual cortex , 1999, Nature.

[57]  Hermann J Müller,et al.  Object maintenance beyond their visible parts in working memory 1 , 2018 .

[58]  Jeffrey S. Johnson,et al.  The recognition of partially visible natural objects in the presence and absence of their occluders , 2005, Vision Research.

[59]  Kunihiko Fukushima,et al.  Neural network model for completing occluded contours , 2010, Neural Networks.

[60]  Victor A. F. Lamme,et al.  Confuse Your Illusion , 2013, Psychological science.

[61]  Barton L Anderson,et al.  The demise of the identity hypothesis and the insufficiency and nonnecessity of contour relatability in predicting object interpolation: comment on Kellman, Garrigan, and Shipley (2005). , 2007, Psychological review.

[62]  Seth A. Herd,et al.  The Role of Competitive Inhibition and Top-Down Feedback in Binding during Object Recognition , 2012, Front. Psychology.

[63]  Yalda Mohsenzadeh,et al.  Beyond Core Object Recognition: Recurrent processes account for object recognition under occlusion , 2019, PLoS Comput. Biol..

[64]  P. A. Van Der Helm,et al.  Accessibility: a criterion for regularity and hierarchy in visual pattern codes , 1991 .

[65]  Mariella Dimiccoli,et al.  A Computational Model for Amodal Completion , 2015, Journal of Mathematical Imaging and Vision.

[66]  M. Seghier,et al.  Functional Neuroimaging Findings on the Human Perception of Illusory Contours , 2022 .

[67]  Takashi Hanakawa,et al.  Topographic Representation of an Occluded Object and the Effects of Spatiotemporal Context in Human Early Visual Areas , 2013, The Journal of Neuroscience.

[68]  T. S. Lee,et al.  Dynamics of subjective contour formation in the early visual cortex. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[69]  A. Michotte,et al.  Les compléments amodaux des structures perceptives , 1964 .

[70]  Gennady Erlikhman,et al.  Decoding information about dynamically occluded objects in visual cortex , 2017, NeuroImage.

[71]  F. Boselie,et al.  A good-continuation model of some occlusion phenomena , 1992, Psychological research.

[72]  Mary A. Peterson,et al.  Amodal Completion in Visual Search , 2004, Psychological science.

[73]  G. Rizzolatti,et al.  I Know What You Are Doing A Neurophysiological Study , 2001, Neuron.

[74]  G. Caputo,et al.  Amodal completion in texture visual evoked potentials , 1999, Vision Research.

[75]  Cees van Leeuwen,et al.  The Mosaic Stage in Amodal Completion as Characterized by Magnetoencephalography Responses , 2006, Journal of Cognitive Neuroscience.

[76]  Shuicheng Yan,et al.  Robust LSTM-Autoencoders for Face De-Occlusion in the Wild , 2016, IEEE Transactions on Image Processing.

[77]  Joseph R. Madsen,et al.  Spatiotemporal Dynamics Underlying Object Completion in Human Ventral Visual Cortex , 2014, Neuron.

[78]  Kunihiko Fukushima,et al.  Neocognitron: A hierarchical neural network capable of visual pattern recognition , 1988, Neural Networks.

[79]  Kunihiko Fukushima Recognition of partly occluded patterns: a neural network model , 2001, Biological Cybernetics.

[80]  Alison Harris,et al.  The Representation of Parts and Wholes in Face-selective Cortex , 2008, Journal of Cognitive Neuroscience.

[81]  D. Perrett,et al.  Neuronal representation of disappearing and hidden objects in temporal cortex of the macaque , 2001, Experimental Brain Research.

[82]  N. Kanwisher,et al.  The fusiform face area: a cortical region specialized for the perception of faces , 2006, Philosophical Transactions of the Royal Society B: Biological Sciences.

[83]  S. J. Hazenberg,et al.  Temporal properties of amodal completion: Influences of knowledge , 2018, Vision Research.

[84]  Michael S. Gazzaniga,et al.  Illusory Contour Perception and Amodal Boundary Completion: Evidence of a Dissociation Following Callosotomy , 1999, Journal of Cognitive Neuroscience.

[85]  Shinsuke Shimojo,et al.  Dynamic Shape Integration in Extrastriate Cortex , 2002, Current Biology.

[86]  E. Leeuwenberg,et al.  Coding theory of visual pattern completion. , 1981, Journal of experimental psychology. Human perception and performance.

[87]  M. A. O. Ignacio,et al.  How to cite this article , 2016 .

[88]  John J. Foxe,et al.  Setting Boundaries: Brain Dynamics of Modal and Amodal Illusory Shape Completion in Humans , 2004, The Journal of Neuroscience.

[89]  J. Maunsell,et al.  Neuronal correlates of inferred motion in primate posterior parietal cortex , 1995, Nature.

[90]  E. Leeuwenberg,et al.  Goodness of visual regularities: a nontransformational approach. , 1996, Psychological review.

[91]  G. Butterworth,et al.  Michotte's experimental phenomenology of perception , 1994 .

[92]  W. Gerbino,et al.  Contour interpolation by vector-field combination. , 2003, Journal of vision.

[93]  Philip J. Kellman,et al.  A unified model of illusory and occluded contour interpolation , 2010, Vision Research.

[94]  Tiangang Zhou,et al.  Cortical Dynamics Underlying Face Completion in Human Visual System , 2010, The Journal of Neuroscience.

[95]  Fang Fang,et al.  Time course of amodal completion in face perception , 2009, Vision Research.

[96]  Kunihiko Fukushima,et al.  Restoring partly occluded patterns: a neural network model , 2005, Neural Networks.

[97]  R. van Lier,et al.  Volume completion in 4.5-month-old infants. , 2011, Acta psychologica.

[98]  A. Sekuler Local and Global Minima in Visual Completion: Effects of Symmetry and Orientation , 1994, Perception.

[99]  G. Kanizsa Subjective contours. , 1976, Scientific American.

[100]  David J. Jilk,et al.  Early recurrent feedback facilitates visual object recognition under challenging conditions , 2014, Front. Psychol..

[101]  Anitha Pasupathy,et al.  Partial Occlusion Modulates Contour-Based Shape Encoding in Primate Area V4 , 2011, The Journal of Neuroscience.

[102]  S Zeki,et al.  The sightless view: neural correlates of occluded objects. , 2007, Cerebral cortex.

[103]  R. Zemel,et al.  Experience-Dependent Perceptual Grouping and Object-Based Attention , 2002 .

[104]  E. Leeuwenberg Quantitative specification of information in sequential patterns. , 1969, Psychological review.