In-vivo imaging of neural activity with dynamic vision sensors

Optical recording of neural activity using calcium or voltage indicators requires cameras capable of detecting small temporal contrast in light intensity with sample rates of 10 Hz to 1 kHz. Large pixel scientific CMOS image sensors (sCMOS) are typically used due to their high resolution, high frame rate, and low noise. However, using such sensors for long-term recording is challenging due to their high data rates of up to 1 Gb/s. Here we studied the use of dynamic vision sensor (DVS) event cameras for neural recording. DVS have high dynamic range and a sparse asynchronous output consisting of brightness change events. Using DVS for neural recording could avoid transferring and storing redundant information. We compared the use of a Hamamatsu Orca V2 sCMOS with two advanced DVS sensors (a higher temporal contrast sensitivity 188×180 pixel SDAVIS and a 346×260 pixel higher light sensitivity back-side-illuminated BSIDAVIS) for neural activity recordings with fluorescent calcium indicators both in brain slices and awake mice. The DVS activity responds to the fast dynamics of neural activity, indicating that a sensor combining SDAVIS and BSIDAVIS technologies would be beneficial for long-term in-vivo neural recording using calcium indicators as well as potentially faster voltage indicators.

[1]  Konrad P Kording,et al.  How advances in neural recording affect data analysis , 2011, Nature Neuroscience.

[2]  T. Delbruck,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < 1 , 2022 .

[3]  Bernabé Linares-Barranco,et al.  A 128$\,\times$ 128 1.5% Contrast Sensitivity 0.9% FPN 3 µs Latency 4 mW Asynchronous Frame-Free Dynamic Vision Sensor Using Transimpedance Preamplifiers , 2013, IEEE Journal of Solid-State Circuits.

[4]  Tobi Delbruck,et al.  A Dynamic Vision Sensor With 1% Temporal Contrast Sensitivity and In-Pixel Asynchronous Delta Modulator for Event Encoding , 2015, IEEE Journal of Solid-State Circuits.

[5]  Stefan R. Pulver,et al.  Ultra-sensitive fluorescent proteins for imaging neuronal activity , 2013, Nature.

[6]  Nathan C. Klapoetke,et al.  Transgenic Mice for Intersectional Targeting of Neural Sensors and Effectors with High Specificity and Performance , 2015, Neuron.

[7]  Tobi Delbruck,et al.  A Sensitive Dynamic and Active Pixel Vision Sensor for Color or Neural Imaging Applications , 2017, IEEE Transactions on Biomedical Circuits and Systems.

[8]  Tobi Delbruck,et al.  A 240 × 180 130 dB 3 µs Latency Global Shutter Spatiotemporal Vision Sensor , 2014, IEEE Journal of Solid-State Circuits.

[9]  Benjamin F. Grewe,et al.  High-speed recording of neural spikes in awake mice and flies with a fluorescent voltage sensor , 2015, Science.

[10]  Benjamin F. Grewe,et al.  High-speed in vivo calcium imaging reveals neuronal network activity with near-millisecond precision , 2010, Nature Methods.

[11]  Tobi Delbrück,et al.  A 128$\times$ 128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor , 2008, IEEE Journal of Solid-State Circuits.