A visual targeting system for the microinjection of unstained adherent cells

Automatic localization and targeting are critical steps in automating the process of microinjecting adherent cells. This process is currently performed manually by highly trained operators and is characterized as a laborious task with low success rate. Therefore, automation is desired to increase the efficiency and consistency of the operations. This research offers a contribution to this procedure through the development of a vision system for a robotic microinjection setup. Its goals are to automatically locate adherent cells in a culture dish and target them for a microinjection. Here the major concern was the achievement of an error-free targeting system to guarantee high consistency in microinjection experiments. To accomplish this, a novel visual targeting algorithm integrating different image processing techniques was proposed. This framework employed defocusing microscopy to highlight cell features and improve cell segmentation and targeting reliability. Three main image processing techniques, operating at three different focus levels in a bright field (BF) microscope, were used: an anisotropic contour completion (ACC) method, a local intensity variation background-foreground classifier, and a grayscale threshold-based segmentation. The proposed framework combined information gathered by each of these methods using a validation map and this was shown to provide reliable cell targeting results. Experiments conducted with sets of real images from two different cell lines (CHO-K1 and HEK), which contained a total of more than 650 cells, yielded flawless targeting results along with a cell detection ratio greater than 50%.

[1]  Franz Kummert,et al.  Automatic Segmentation of Unstained Living Cells in Bright-Field Microscope Images , 2006, Industrial Conference on Data Mining - Workshops.

[2]  Darwin G. Caldwell,et al.  Anisotropic Contour Completion for Cell Microinjection Targeting , 2010, 2010 20th International Conference on Pattern Recognition.

[3]  Justin W. L. Wan,et al.  A combined watershed and level set method for segmentation of brightfield cell images , 2009, Medical Imaging.

[4]  S. Mookerjee,et al.  Toxicating effect of Janus green B , 2004, Naturwissenschaften.

[5]  Hans De Sterck,et al.  Multilevel Space-Time Aggregation for Bright Field Cell Microscopy Segmentation and Tracking , 2010, Int. J. Biomed. Imaging.

[6]  Wesley E. Snyder,et al.  Machine Vision , 2003 .

[7]  Michael Brady,et al.  PHASE-BASED SEGMENTATION OF CELLS FROM BRIGHTFIELD MICROSCOPY , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[8]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Xi Long,et al.  Automatic detection of unstained viable cells in bright field images using a support vector machine with an improved training procedure , 2006, Comput. Biol. Medicine.

[10]  Sim Heng Ong,et al.  Autofocusing for tissue microscopy , 1993, Image Vis. Comput..

[11]  R. Malladi,et al.  Segmentation of nuclei and cells using membrane related protein markers , 2001, Journal of microscopy.

[12]  Carlos Ortiz-de-Solorzano,et al.  High-throughput analysis of multispectral images of breast cancer tissue , 2006, IEEE Transactions on Image Processing.

[13]  Xi Long,et al.  A new preprocessing approach for cell recognition , 2005, IEEE Transactions on Information Technology in Biomedicine.

[14]  広 久保田,et al.  Principle of Optics , 1960 .

[15]  Anne E Carpenter,et al.  Systematic genome-wide screens of gene function , 2004, Nature Reviews Genetics.

[16]  Jerry L. Prince,et al.  Snakes, shapes, and gradient vector flow , 1998, IEEE Trans. Image Process..

[17]  Katie F Wlaschin,et al.  Recombinant protein therapeutics from CHO cells : 20 years and counting , 2007 .

[18]  Zhang Yi,et al.  Software Based Vision System for Automated Cell Injection , 2008, 2008 International Conference on BioMedical Engineering and Informatics.

[19]  Yu Sun,et al.  A system for high-speed microinjection of adherent cells. , 2008, The Review of scientific instruments.

[20]  Ingrid Schmid,et al.  Live-cell assay for detection of apoptosis by dual-laser flow cytometry using Hoechst 33342 and 7-amino-actinomycin D , 2007, Nature Protocols.

[21]  John C. Russ,et al.  Image Processing Handbook, Fourth Edition , 2002 .

[22]  Michael Brady,et al.  Automatic segmentation of adherent biological cell boundaries and nuclei from brightfield microscopy images , 2012, Machine Vision and Applications.

[23]  M. Terasaki,et al.  Fluorescent labeling of endoplasmic reticulum. , 1989, Methods in cell biology.

[24]  Franz Kummert,et al.  Classification of Segmented Regions in Brightfield Microscope Images , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[25]  Fumihito Arai,et al.  Bio-micromanipulation (new direction for operation improvement) , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[26]  Petia Radeva,et al.  Extending anisotropic operators to recover smooth shapes , 2005, Comput. Vis. Image Underst..

[27]  Joachim Weickert,et al.  Theoretical Foundations of Anisotropic Diffusion in Image Processing , 1994, Theoretical Foundations of Computer Vision.

[28]  Joachim Weickert,et al.  A Review of Nonlinear Diffusion Filtering , 1997, Scale-Space.

[29]  John C. Russ,et al.  The Image Processing Handbook , 2016, Microscopy and Microanalysis.

[30]  Kenong Wu,et al.  Live cell image segmentation , 1995, IEEE Transactions on Biomedical Engineering.

[31]  Gang-Yu Liu,et al.  Cell tracing dyes significantly change single cell mechanics. , 2009, The journal of physical chemistry. B.

[32]  Erlend Hodneland,et al.  A Unified Framework for Automated 3-D Segmentation of Surface-Stained Living Cells and a Comprehensive Segmentation Evaluation , 2009, IEEE Transactions on Medical Imaging.

[33]  Edward Grant,et al.  Blastocyst Microinjection Automation , 2009, IEEE Transactions on Information Technology in Biomedicine.

[34]  Darwin G. Caldwell,et al.  Diffusion tensor driven contour closing for cell microinjection targeting , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[35]  R. Gazzinelli,et al.  Cell surface fluctuations studied with defocusing microscopy. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[36]  P J Sjöström,et al.  Artificial neural network-aided image analysis system for cell counting. , 1999, Cytometry.

[37]  Pekka Ruusuvuori,et al.  Bright Field Microscopy as an Alternative to Whole Cell Fluorescence in Automated Analysis of Macrophage Images , 2009, PloS one.