Detection of cellular micromotion by advanced signal processing

Cellular micromotion—a tiny movement of cell membranes on the nm-µm scale—has been proposed as a pathway for inter-cellular signal transduction and as a label-free proxy signal to neural activity. Here we harness several recent approaches of signal processing to detect such micromotion in video recordings of unlabeled cells. Our survey includes spectral filtering of the video signal, matched filtering, as well as 1D and 3D convolutional neural networks acting on pixel-wise time-domain data and a whole recording respectively.

[1]  Hunter Gabbard,et al.  Matching Matched Filtering with Deep Networks for Gravitational-Wave Astronomy. , 2017, Physical review letters.

[2]  Wei Dai,et al.  Very deep convolutional neural networks for raw waveforms , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  R. C. Macridis.  A review , 1963 .

[4]  R. Fields,et al.  Signaling by Neuronal Swelling , 2011, Science Signaling.

[5]  R. Keynes,et al.  Opacity changes in stimulated nerve , 1949, The Journal of physiology.

[6]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[7]  Ming Yang,et al.  3D Convolutional Neural Networks for Human Action Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Kevin C. Boyle,et al.  Full-field interferometric imaging of propagating action potentials , 2018, Light: Science & Applications.

[9]  Field Rd.  Signaling by Neuronal Swelling , 2011 .

[10]  Germain Forestier,et al.  Deep learning for time series classification: a review , 2018, Data Mining and Knowledge Discovery.

[11]  Loan Bui,et al.  Label-free optical detection of action potential in mammalian neurons. , 2017, Biomedical optics express.

[12]  Interferometric detection of action potentials. , 2012, Cold Spring Harbor protocols.

[13]  I. Bigio,et al.  Real-time imaging of action potentials in nerves using changes in birefringence , 2016, Biomedical optics express.

[14]  D. Kleinfeld,et al.  Noninvasive detection of changes in membrane potential in cultured neurons by light scattering. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[15]  R. Keynes,et al.  Light Scattering and Birefringence Changes during Nerve Activity , 1968, Nature.

[16]  Takashi Kawashima,et al.  Bright and photostable chemigenetic indicators for extended in vivo voltage imaging , 2018 .

[17]  Donald G. Dansereau,et al.  Interactive computational imaging for deformable object analysis , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[18]  A. Villringer,et al.  Near infrared spectroscopy (NIRS): A new tool to study hemodynamic changes during activation of brain function in human adults , 1993, Neuroscience Letters.

[19]  Xincheng Yao.  Intrinsic optical signal imaging of retinal activation , 2009, Japanese Journal of Ophthalmology.

[20]  C. Fang-Yen,et al.  Label-free imaging of membrane potential using membrane electromotility. , 2012, Biophysical journal.

[21]  R. Keynes,et al.  Changes in axon birefringence during the action potential , 1970, The Journal of physiology.

[22]  Richard W. Taylor,et al.  Interferometric Scattering Microscopy: Seeing Single Nanoparticles and Molecules via Rayleigh Scattering , 2019, Nano letters.

[23]  F Sachs,et al.  Voltage-induced membrane movement , 2001, Nature.

[24]  K. Iwasa,et al.  Swelling of nerve fibers associated with action potentials. , 1980, Science.

[25]  L. Lathauwer,et al.  Detection of fast neuronal signals in the motor cortex from functional near infrared spectroscopy measurements using independent component analysis , 2006, Medical and Biological Engineering and Computing.

[26]  Gerald Penn,et al.  Convolutional Neural Networks for Speech Recognition , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[27]  Yunze Yang,et al.  Imaging Action Potential in Single Mammalian Neurons by Tracking the Accompanying Sub-Nanometer Mechanical Motion. , 2018, ACS nano.

[28]  R. Andrew,et al.  Potential sources of intrinsic optical signals imaged in live brain slices. , 1999, Methods.

[29]  B. C. Hill,et al.  Laser interferometer measurement of changes in crayfish axon diameter concurrent with action potential. , 1977, Science.

[30]  Gary H. Glover,et al.  A quantitative comparison of NIRS and fMRI across multiple cognitive tasks , 2011, NeuroImage.

[31]  R. Bashir,et al.  How far cardiac cells can see each other mechanically , 2011 .

[32]  Xincheng Yao,et al.  In vivo optical coherence tomography of stimulus-evoked intrinsic optical signals in mouse retinas , 2016, Journal of biomedical optics.

[33]  D. M. Rector,et al.  Optically teasing apart neural swelling and depolarization , 2007, Neuroscience.

[34]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..

[35]  Klaus-Robert Müller,et al.  Enhanced Performance by a Hybrid Nirs–eeg Brain Computer Interface , 2022 .

[36]  D. O. North,et al.  An Analysis of the factors which determine signal/noise discrimination in pulsed-carrier systems , 1963 .

[37]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[38]  T. Wiesel,et al.  Functional architecture of cortex revealed by optical imaging of intrinsic signals , 1986, Nature.

[39]  N J Izzo,et al.  HL-1 cells: a cardiac muscle cell line that contracts and retains phenotypic characteristics of the adult cardiomyocyte. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[40]  K. Aalto-Setälä,et al.  Simultaneous recordings of action potentials and calcium transients from human induced pluripotent stem cell derived cardiomyocytes , 2018, Biology Open.

[41]  B. MacVicar,et al.  Imaging of synaptically evoked intrinsic optical signals in hippocampal slices , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[42]  Hellmuth Obrig,et al.  The fast optical signal—Robust or elusive when non-invasively measured in the human adult? , 2005, NeuroImage.

[43]  H. Rylander Iii,et al.  Detection of neural activity using phase-sensitive optical low-coherence reflectometry. , 2004, Optics express.

[44]  Yu Zhang,et al.  Multi-functional bismuth-doped bioglasses: combining bioactivity and photothermal response for bone tumor treatment and tissue repair , 2018, Light: Science & Applications.

[45]  H. Seung,et al.  Noncontact measurement of nerve displacement during action potential with a dual-beam low-coherence interferometer. , 2004, Optics letters.