Optical flow of vesicles: computer vision approach for endocytosis of nanoparticles in a living cell

The movement of vesicle in a living cell includes essential information for understanding the details of the intracellular transport. Although the vesicle tracking method has allowed us to understand precise movement of a single nanoparticle from the physical point of view, the whole cell-level transport has still not been clearly explained with the analysis of only a few representative vesicle movements. In this study, as an initial attempt to gain insight into cell-level vesicle transport, we adopted a computer vision technique to analyze the overall intracellular vesicle transport. In detail, we propose an algorithm to estimate and visualize the ow of the entire endocytic vesicles in terms of convergence and divergence with respect to the geometric cell center. In this algorithm, optical ow of the fluorescent nanoparticles in a living cell is computed using Lucas-Kanade method. Then, the direction of vesicle movement regarding the geometric center of the cell is calculated and mapped to visualize either converging or diverging movement, based on four-quadrant inverse tangent. With this suggested method, it is expected that we can gain insight into cell-level vesicle transport, which can help design and quantitatively evaluate various biomedical applications, including drug delivery.

[1]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[2]  Masatoshi Ishikawa,et al.  3D Nanoscale Tracking Data Analysis for Intracellular Organelle Movement using Machine Learning Approach , 2019, 2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC).

[3]  Gabriel A. Silva,et al.  Mapping the Spatiotemporal Dynamics of Calcium Signaling in Cellular Neural Networks Using Optical Flow , 2009, Annals of Biomedical Engineering.

[4]  Hyuno Kim,et al.  Focus stabilization by axial position feedback in biomedical imaging microscopy , 2018, 2018 IEEE Sensors Applications Symposium (SAS).

[5]  Hyuno Kim,et al.  Numerical method for vesicle movement analysis in a complex cytoskeleton network. , 2018, Optics express.

[6]  H. Higuchi,et al.  3D rotational motion of an endocytic vesicle on a complex microtubule network in a living cell , 2019, bioRxiv.

[7]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[8]  I. Rosen,et al.  The design and testing of novel clinical parameters for dose comparison. , 2003, International journal of radiation oncology, biology, physics.

[9]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[10]  Mark von Zastrow,et al.  Signal transduction and endocytosis: close encounters of many kinds , 2002, Nature Reviews Molecular Cell Biology.

[11]  Gunnar Farnebäck,et al.  Two-Frame Motion Estimation Based on Polynomial Expansion , 2003, SCIA.

[12]  Hideo Higuchi,et al.  Three-dimensional nanometry of vesicle transport in living cells using dual-focus imaging optics. , 2007, Biochemical and biophysical research communications.

[13]  Tadakuni Narabu,et al.  High-S/N imaging of a moving object using a high-frame-rate camera , 2008, 2008 15th IEEE International Conference on Image Processing.

[14]  Nancy A Monteiro-Riviere,et al.  Mechanisms of quantum dot nanoparticle cellular uptake. , 2009, Toxicological sciences : an official journal of the Society of Toxicology.

[15]  Javier Ruiz-del-Solar,et al.  Performance of optical flow techniques for motion analysis of fluorescent point signals in confocal microscopy , 2012, Machine Vision and Applications.

[16]  M. Kurosumi,et al.  Isolation and characterization of a new human breast cancer cell line, KPL-4, expressing the Erb B family receptors and interleukin-6 , 1999, British Journal of Cancer.

[17]  Hideo Higuchi,et al.  Stepwise movements in vesicle transport of HER2 by motor proteins in living cells. , 2007, Biophysical journal.