BetaBuddy: An end-to-end computer vision pipeline for the automated analysis of insulin secreting β-cells

Insulin secretion from pancreatic β-cells is integral in maintaining the delicate equilibrium of blood glucose levels. Calcium is known to be a key regulator and triggers the release of insulin. This sub-cellular process can be monitored and tracked through live-cell imaging and subsequent cell segmentation, registration, tracking, and analysis of the calcium level in each cell. Current methods of analysis typically require the manual outlining of β-cells, involve multiple software packages, and necessitate multiple researchers - all of which tend to introduce biases. Utilizing deep learning algorithms, we have therefore created a pipeline to automatically segment and track thousands of cells, which greatly reduces the time required to gather and analyze a large number of sub-cellular images and improve accuracy. Tracking cells over a time-series image stack also allows researchers to isolate specific calcium spiking patterns and spatially identify those of interest, creating an efficient and user-friendly analysis tool. Using our automated pipeline, a previous dataset used to evaluate changes in calcium spiking activity in β-cells post-electric field stimulation was reanalyzed. Changes in spiking activity were found to be underestimated previously with manual segmentation. Moreover, the machine learning pipeline provides a powerful and rapid computational approach to examine, for example, how calcium signaling is regulated by intracellular interactions in a cluster of β-cells.

[1]  V. Dia,et al.  A novel automated protocol for ice crystal segmentation analysis using Cellpose and Fiji. , 2023, Cryobiology.

[2]  K. Troidl,et al.  Deetect: A Deep Learning-Based Image Analysis Tool for Quantification of Adherent Cell Populations on Oxygenator Membranes after Extracorporeal Membrane Oxygenation Therapy , 2022, Biomolecules.

[3]  D. Stockholm,et al.  Artificial intelligence workflow quantifying muscle features on Hematoxylin–Eosin stained sections reveals dystrophic phenotype amelioration upon treatment , 2022, Scientific Reports.

[4]  P. Heng,et al.  Deep Learning in Cell Image Analysis , 2022, Intelligent Computing.

[5]  Marius Pachitariu,et al.  Cellpose 2.0: how to train your own model , 2022, bioRxiv.

[6]  Michael Cho,et al.  Stimulatory responses in α‐ and β‐cells by near‐infrared (810 nm) photobiomodulation , 2021, Journal of biophotonics.

[7]  Romain F. Laine,et al.  Bringing TrackMate into the era of machine-learning and deep-learning , 2021, bioRxiv.

[8]  Sergey Ablameyko,et al.  A survey on applications of deep learning in microscopy image analysis , 2021, Comput. Biol. Medicine.

[9]  Surya R. Kalidindi,et al.  Automated Image Processing Workflow for Morphological Analysis of Fluorescence Microscopy Cell Images , 2021, JOM.

[10]  B. Clough,et al.  HRMAn 2.0: Next‐generation artificial intelligence–driven analysis for broad host–pathogen interactions , 2021, Cellular microbiology.

[11]  A. Waisman,et al.  Automatic and unbiased segmentation and quantification of myofibers in skeletal muscle , 2021, Scientific Reports.

[12]  D. Melton The promise of stem cell-derived islet replacement therapy , 2021, Diabetologia.

[13]  Andreas E. Zautner,et al.  YSMR: a video tracking and analysis program for bacterial motility , 2020, BMC Bioinformatics.

[14]  Bo Chen,et al.  Altered β-Cell Calcium Dynamics via Electric Field Exposure , 2020, Annals of Biomedical Engineering.

[15]  Jeroen S. van Zon,et al.  OrganoidTracker: Efficient cell tracking using machine learning and manual error correction , 2020, bioRxiv.

[16]  A. Tengholm,et al.  Metabolic regulation of calcium signaling in beta cells. , 2020, Seminars in cell & developmental biology.

[17]  M. Perkuhn,et al.  Automated Meningioma Segmentation in Multiparametric MRI , 2020, Clinical Neuroradiology.

[18]  Marius Pachitariu,et al.  Cellpose: a generalist algorithm for cellular segmentation , 2020, Nature Methods.

[19]  Lewis Mosby,et al.  A Python based automated tracking routine for myosin II filaments , 2020, Journal of Physics D: Applied Physics.

[20]  M. Pichler,et al.  Calcium Signaling in ß-cell Physiology and Pathology: A Revisit , 2019, International journal of molecular sciences.

[21]  Hugo Jair Escalante,et al.  Split and merge watershed: A two-step method for cell segmentation in fluorescence microscopy images , 2019, Biomed. Signal Process. Control..

[22]  Johannes Stegmaier,et al.  CNN-Based Preprocessing to Optimize Watershed-Based Cell Segmentation in 3D Confocal Microscopy Images , 2018, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[23]  Eugene W. Myers,et al.  Cell Detection with Star-convex Polygons , 2018, MICCAI.

[24]  G. da Silva Xavier The Cells of the Islets of Langerhans , 2018, Journal of clinical medicine.

[25]  Johannes Schindelin,et al.  TrackMate: An open and extensible platform for single-particle tracking. , 2017, Methods.

[26]  Peter Bankhead,et al.  QuPath: Open source software for digital pathology image analysis , 2017, Scientific Reports.

[27]  Juho Kannala,et al.  Cell Segmentation Proposal Network for Microscopy Image Analysis , 2016, LABELS/DLMIA@MICCAI.

[28]  Jaime S. Cardoso,et al.  Deep Learning and Data Labeling for Medical Applications , 2016, Lecture Notes in Computer Science.

[29]  H. Sebastian Seung,et al.  Automatic Neuron Detection in Calcium Imaging Data Using Convolutional Networks , 2016, NIPS.

[30]  F. Ashcroft,et al.  KATP channels and islet hormone secretion: new insights and controversies , 2013, Nature Reviews Endocrinology.

[31]  L. Dimeglio,et al.  Type 1 Diabetes , 2019, Epidemiology of Diabetes.

[32]  Can Fahrettin Koyuncu,et al.  Smart Markers for Watershed-Based Cell Segmentation , 2012, PloS one.

[33]  Johannes E. Schindelin,et al.  Fiji: an open-source platform for biological-image analysis , 2012, Nature Methods.

[34]  Md. Asri Ngadi,et al.  Red blood cell segmentation using masking and watershed algorithm: A preliminary study , 2012, 2012 International Conference on Biomedical Engineering (ICoBE).

[35]  S. Bonner-Weir,et al.  Quantitative analysis of cell composition and purity of human pancreatic islet preparations , 2010, Laboratory Investigation.

[36]  Min Zhang,et al.  Gap junction coupling and calcium waves in the pancreatic islet. , 2008, Biophysical journal.

[37]  Kannappan Palaniappan,et al.  Multi-feature contour evolution for automatic live cell segmentation in time lapse imagery , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[38]  G Li,et al.  Segmentation of touching cell nuclei using gradient flow tracking , 2008, Journal of microscopy.

[39]  Camillo Ricordi,et al.  The unique cytoarchitecture of human pancreatic islets has implications for islet cell function , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[40]  Alvin C. Powers,et al.  Assessment of Human Pancreatic Islet Architecture and Composition by Laser Scanning Confocal Microscopy , 2005, The journal of histochemistry and cytochemistry : official journal of the Histochemistry Society.

[41]  Jae-Hyoung Cho,et al.  Selective β-Cell Loss and α-Cell Expansion in Patients with Type 2 Diabetes Mellitus in Korea , 2003 .

[42]  Vannary Meas-Yedid,et al.  Segmentation and tracking of migrating cells in videomicroscopy with parametric active contours: a tool for cell-based drug testing , 2002, IEEE Transactions on Medical Imaging.

[43]  W. H. Evans,et al.  Gap junctions: structure and function (Review) , 2002, Molecular membrane biology.

[44]  J J Vaquero,et al.  Applying watershed algorithms to the segmentation of clustered nuclei. , 1998, Cytometry.

[45]  Jeremiah Neubert,et al.  Deep learning approaches to biomedical image segmentation , 2020 .