Microscope-Cockpit: Python-based bespoke microscopy for bio-medical science

We have developed “Microscope-Cockpit” (Cockpit), a highly adaptable open source user-friendly Python-based GUI environment for precision control of both simple and elaborate bespoke microscope systems. The user environment allows next-generation near-instantaneous navigation of the entire slide landscape for efficient selection of specimens of interest and automated acquisition without the use of eyepieces. Cockpit uses “Python-Microscope” (Microscope) for high-performance coordinated control of a wide range of hardware devices using open source software. Microscope also controls complex hardware devices such as deformable mirrors for aberration correction and spatial light modulators for structured illumination via abstracted device models. We demonstrate the advantages of the Cockpit platform using several bespoke microscopes, including a simple widefield system and a complex system with adaptive optics and structured illumination. A key strength of Cockpit is its use of Python, which means that any microscope built with Cockpit is ready for future customisation by simply adding new libraries, for example machine learning algorithms to enable automated microscopy decision making while imaging. Highlights User-friendly setup and use for simple to complex bespoke microscopes. Facilitates collaborations between biomedical scientists and microscope technologists. Touchscreen for near-instantaneous navigation of specimen landscape. Uses Python-Microscope, for abstracted open source hardware device control. Well-suited for user training of AI-algorithms for automated microscopy.

[1]  Shalin B. Mehta,et al.  Pycro-Manager: open-source software for customized and reproducible microscope control , 2021, Nature Methods.

[2]  Ian M. Dobbie,et al.  MicronOxford/cockpit release-2.9.1 , 2021 .

[3]  David Miguel Susano Pinto,et al.  Python-Microscope – a new open-source Python library for the control of microscopes , 2021, bioRxiv.

[4]  P. Paul-Gilloteaux,et al.  3D Correlative Cryo-Structured Illumination Fluorescence and Soft X-ray Microscopy Elucidates Reovirus Intracellular Release Pathway , 2020, Cell.

[5]  Jaime Fern'andez del R'io,et al.  Array programming with NumPy , 2020, Nature.

[6]  Martin J. Booth,et al.  Microscope-AOtools: a generalised adaptive optics implementation , 2020, bioRxiv.

[7]  J. Sedat,et al.  CryoSIM: super-resolution 3D structured illumination cryogenic fluorescence microscopy for correlated ultrastructural imaging , 2020, bioRxiv.

[8]  M. J. Booth,et al.  Wavefront‐sensorless adaptive optics with a laser‐free spinning disk confocal microscope , 2020, bioRxiv.

[9]  Joel Nothman,et al.  SciPy 1.0-Fundamental Algorithms for Scientific Computing in Python , 2019, ArXiv.

[10]  Thomas Huser,et al.  Video-rate multi-color structured illumination microscopy with simultaneous real-time reconstruction , 2019, Nature Communications.

[11]  Eric Betzig,et al.  Dynamic super-resolution structured illumination imaging in the living brain , 2019, Proceedings of the National Academy of Sciences.

[12]  Jason R. Swedlow,et al.  Full volume super-resolution imaging of thick mitotic spindle using 3D AO STED microscope. , 2019, Biomedical optics express.

[13]  Sjoerd Stallinga,et al.  Localization microscopy at doubled precision with patterned illumination , 2019, bioRxiv.

[14]  Martin J Booth,et al.  IsoSense: frequency enhanced sensorless adaptive optics through structured illumination , 2018, bioRxiv.

[15]  Susan Cox,et al.  Artefact-free high density localization microscopy analysis , 2018 .

[16]  S. Hell,et al.  MINFLUX monitors rapid molecular jumps with superior spatiotemporal resolution , 2018, Proceedings of the National Academy of Sciences.

[17]  Elliot M. Meyerowitz,et al.  Observing the cell in its native state: Imaging subcellular dynamics in multicellular organisms , 2018, Science.

[18]  Geoffrey J Evans,et al.  Random-access scanning microscopy for 3D imaging in awake behaving animals , 2016, Nature Methods.

[19]  Ian M. Dobbie,et al.  SIMcheck: a Toolbox for Successful Super-resolution Structured Illumination Microscopy , 2015, Scientific Reports.

[20]  Ernst H K Stelzer,et al.  Light-sheet fluorescence microscopy for quantitative biology , 2014, Nature Methods.

[21]  Wesley R. Legant,et al.  Lattice light-sheet microscopy: Imaging molecules to embryos at high spatiotemporal resolution , 2014, Science.

[22]  Martin J. Booth,et al.  Adaptive optical microscopy: the ongoing quest for a perfect image , 2014, Light: Science & Applications.

[23]  Henry Pinkard,et al.  Micro-Magellan: open-source, sample-adaptive, acquisition software for optical microscopy , 2016, Nature Methods.

[24]  Andrew G. York,et al.  Instant super-resolution imaging in live cells and embryos via analog image processing , 2013, Nature Methods.

[25]  Johannes E. Schindelin,et al.  OpenSPIM: an open-access light-sheet microscopy platform , 2013, Nature Methods.

[26]  E. Rosten,et al.  ImageJ plug-in for Bayesian analysis of blinking and bleaching , 2013, Nature Methods.

[27]  Martin J Booth,et al.  Adaptive optics enables 3D STED microscopy in aberrating specimens. , 2012, Optics express.

[28]  John W Sedat,et al.  OMX: a new platform for multimodal, multichannel wide-field imaging. , 2011, Cold Spring Harbor protocols.

[29]  S. Holden,et al.  DAOSTORM: an algorithm for high- density super-resolution microscopy , 2011, Nature Methods.

[30]  Nico Stuurman,et al.  Computer Control of Microscopes Using µManager , 2010, Current protocols in molecular biology.

[31]  Charles Kervrann,et al.  Fast live simultaneous multiwavelength four-dimensional optical microscopy , 2010, Proceedings of the National Academy of Sciences.

[32]  John W Sedat,et al.  Closed loop adaptive optics for microscopy without a wavefront sensor , 2010, BiOS.

[33]  D A Agard,et al.  High‐resolution wide‐field microscopy with adaptive optics for spherical aberration correction and motionless focusing , 2010, Journal of microscopy.

[34]  Kristen M Werner,et al.  Drosophila Larval NMJ Dissection , 2009, Journal of visualized experiments : JoVE.

[35]  M. Gustafsson,et al.  Subdiffraction Multicolor Imaging of the Nuclear Periphery with 3D Structured Illumination Microscopy , 2008, Science.

[36]  John D. Hunter,et al.  Matplotlib: A 2D Graphics Environment , 2007, Computing in Science & Engineering.

[37]  M. Gustafsson.  Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy , 2000, Journal of microscopy.