Interactive Light Stimulus Generation with High Performance Real-Time Image Processing and Simple Scripting

Light stimulation with precise and complex spatial and temporal modulation is demanded by a series of research fields like visual neuroscience, optogenetics, ophthalmology, and visual psychophysics. We developed a user-friendly and flexible stimulus generating framework (GEARS GPU-based Eye And Retina Stimulation Software), which offers access to GPU computing power, and allows interactive modification of stimulus parameters during experiments. Furthermore, it has built-in support for driving external equipment, as well as for synchronization tasks, via USB ports. The use of GEARS does not require elaborate programming skills. The necessary scripting is visually aided by an intuitive interface, while the details of the underlying software and hardware components remain hidden. Internally, the software is a C++/Python hybrid using OpenGL graphics. Computations are performed on the GPU, and are defined in the GLSL shading language. However, all GPU settings, including the GPU shader programs, are automatically generated by GEARS. This is configured through a method encountered in game programming, which allows high flexibility: stimuli are straightforwardly composed using a broad library of basic components. Stimulus rendering is implemented solely in C++, therefore intermediary libraries for interfacing could be omitted. This enables the program to perform computationally demanding tasks like en-masse random number generation or real-time image processing by local and global operations.

[1]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[2]  Jonathan Westley Peirce,et al.  Neuroinformatics Original Research Article Generating Stimuli for Neuroscience Using Psychopy , 2022 .

[3]  Gidon Felsen,et al.  A natural approach to studying vision , 2005, Nature Neuroscience.

[4]  Wolfgang Böhm,et al.  On de Casteljau's algorithm , 1999, Comput. Aided Geom. Des..

[5]  P. Bourke.  Using a spherical mirror for projection into immersive environments , 2005 .

[6]  Jean Bennett,et al.  Efficient transduction and optogenetic stimulation of retinal bipolar cells by a synthetic adeno-associated virus capsid and promoter , 2014, EMBO molecular medicine.

[7]  Nils Jungenfelt,et al.  Contrast enhancement, denoising and fusion in dark video for applications in automobile safety , 2012 .

[8]  Jan Theeuwes,et al.  OpenSesame: An open-source, graphical experiment builder for the social sciences , 2011, Behavior Research Methods.

[9]  Andrew D. Straw,et al.  Vision Egg: an Open-Source Library for Realtime Visual Stimulus Generation , 2008, Frontiers Neuroinformatics.

[10]  Betty J. Mohler,et al.  Effect of Display Technology on Perceived Scale of Space , 2015, Hum. Factors.

[11]  W. Ehrenstein,et al.  Psychophysical Methods , 1999 .

[12]  Mikko Vähäsöyrinki,et al.  A fast and flexible panoramic virtual reality system for behavioural and electrophysiological experiments , 2012, Scientific Reports.

[13]  E J Chichilnisky,et al.  A simple white noise analysis of neuronal light responses , 2001, Network.

[14]  Jonas Kubilius,et al.  A framework for streamlining research workflow in neuroscience and psychology , 2014, Front. Neuroinform..

[15]  E. Wist,et al.  The Scintillating Grid Illusion , 1997, Vision Research.

[16]  Tom Davis,et al.  Opengl programming guide: the official guide to learning opengl , 1993 .

[17]  Michael L. Hines,et al.  Python in neuroscience , 2015, Front. Neuroinform..

[18]  Bartlett W. Mel,et al.  Contour Enhancement Benefits Older Adults with Simulated Central Field Loss , 2022 .

[19]  David H. Eberly,et al.  3D game engine design - a practical approach to real-time computer graphics , 2000 .

[20]  Reinhard Klette,et al.  Concise Computer Vision , 2014, Undergraduate Topics in Computer Science.

[21]  Aapo Hyvärinen,et al.  Natural Image Statistics - A Probabilistic Approach to Early Computational Vision , 2009, Computational Imaging and Vision.

[22]  Zhong-Lin Lu,et al.  Visual Psychophysics: From Laboratory to Theory , 2013 .

[23]  Caelan Reed Garrett,et al.  Image Processing for Human Understanding in Low-visibility , 2011 .