Synthesizing Visual Illusions Using Generative Adversarial Networks

Visual illusions are a very useful tool for vision scientists, because they allow them to better probe the limits, thresholds and errors of the visual system. In this work we introduce the first ever framework to generate novel visual illusions with an artificial neural network (ANN). It takes the form of a generative adversarial network, with a generator of visual illusion candidates and two discriminator modules, one for the inducer background and another that decides whether or not the candidate is indeed an illusion. The generality of the model is exemplified by synthesizing illusions of different types, and validated with psychophysical experiments that corroborate that the outputs of our ANN are indeed visual illusions to human observers. Apart from synthesizing new visual illusions, which may help vision researchers, the proposed model has the potential to open new ways to study the similarities and differences between ANN and human visual perception.

[1]  J. Movshon,et al.  Nature and interaction of signals from the receptive field center and surround in macaque V1 neurons. , 2002, Journal of neurophysiology.

[2]  M. Vanrell,et al.  Toward a unified chromatic induction model. , 2010, Journal of vision.

[3]  Stuart Hannabuss,et al.  The Oxford Compendium of Visual Illusions , 2018 .

[4]  J. Ross,et al.  Contrast adaptation and contrast masking in human vision , 1991, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[5]  H. Helson Studies of anomalous contrast and assimilation. , 1963, Journal of the Optical Society of America.

[6]  M. Morgan,et al.  Predicting the motion after-effect from sensitivity loss , 2006, Vision Research.

[7]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[8]  Valero Laparra,et al.  Visual aftereffects and sensory nonlinearities from a single statistical framework , 2015, Front. Hum. Neurosci..

[9]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[10]  F. Attneave Some informational aspects of visual perception. , 1954, Psychological review.

[11]  Martin Wattenberg,et al.  Do Neural Networks Show Gestalt Phenomena? An Exploration of the Law of Closure , 2019, ArXiv.

[12]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[13]  John M. Foley,et al.  Analysis of the effect of pattern adaptation on pattern pedestal effects: A two-process model , 1997, Vision Research.

[14]  Martin Wattenberg,et al.  Neural Networks Trained on Natural Scenes Exhibit Gestalt Closure , 2021 .

[15]  Karl J. Friston The free-energy principle: a rough guide to the brain? , 2009, Trends in Cognitive Sciences.

[16]  L. Sharpe,et al.  Assimilative hue shifts in color gratings depend on bar width. , 1986, Perception & psychophysics.

[17]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[18]  L. Sharpe,et al.  Assimilative hue shifts in color depend on bar width , 1986 .

[19]  Albert A. Michelson,et al.  Studies in Optics , 1995 .

[20]  M. McCourt,et al.  A multiscale spatial filtering account of the White effect, simultaneous brightness contrast and grating induction , 1999, Vision Research.

[21]  John Harris,et al.  Vision: Coding and efficiency , 1994, Image Vis. Comput..

[22]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[23]  Iasonas Kokkinos,et al.  Describing Textures in the Wild , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  L. Thurstone A law of comparative judgment. , 1994 .

[26]  Colin Blakemore,et al.  Vision: Coding and Efficiency , 1991 .

[27]  A. Kitaoka,et al.  Illusory Motion Reproduced by Deep Neural Networks Trained for Prediction , 2018, Front. Psychol..

[28]  Alexander Gómez Villa,et al.  Convolutional Neural Networks Can Be Deceived by Visual Illusions , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  H Barlow,et al.  Redundancy reduction revisited , 2001, Network.

[30]  H. B. Barlow,et al.  Possible Principles Underlying the Transformations of Sensory Messages , 2012 .

[31]  C. Blakemore,et al.  Adaptation to spatial stimuli. , 1969, The Journal of physiology.

[32]  H. Barlow Vision: A theory about the functional role and synaptic mechanism of visual after-effects , 1991 .

[33]  Frederick A.A. Kingdom,et al.  Lightness, brightness and transparency: A quarter century of new ideas, captivating demonstrations and unrelenting controversy , 2011, Vision Research.