Measure-by-Wire (MBW): An Automatic Control Framework for High-Throughput Transmission Electron Microscopy

Abstract The impressive advances in the nanosciences (i.e., materials science, nanotechnology, and biotechnology) during the past 20 years have been fueled by newly gained understanding of material properties at the nano- and sub-nanometer scales. Much of this understanding was obtained through different forms of electron microscopy, such as scanning, photoemission, and, in particular, transmission electron microscopy. Transmission electron microscopes (TEMs) are unique in that they provide physical, structural, electronic, magnetic, and chemical information down to the atomic scale. Thus, it is now possible to manufacture and inspect devices such as nanotubes and MEMS, and to determine the properties of the nanoparticles of polymers and catalysts. Moreover, tools such as cryo-TEMs and techniques such as TEM electron tomography now allow the 3-D imaging and study of biological cellular machines and macromolecular complexes that occupy volumes of up to a few cubic micrometers. Clearly, TEMs are the tools of choice for academic and industrial research at the nanoscale, and it is expected that they will be increasingly used to perform large numbers of routine, repetitive measurement tasks. Thus, there is a clear need for a new generation of high-throughput TEMs designed to autonomously extract information from specimens (e.g., particle sizes, chemical composition, structural information etc.). In order to develop high-throughput TEMs that operate with maximum efficiency (in terms of time utilization), a new systematic automation paradigm is needed. We propose here one such paradigm called Measure-by-Wire (MBW), which is based on systems and control principles. With this perspective, TEM operators yield the direct control of the microscope’s internal processes to a hierarchy of feedback controllers and high-level supervisors. These use dynamical models of the main TEM components, along with currently available measurement techniques (and new sensors) to automate and execute in parallel, when possible, processes such as defocus correction, specimen displacement, and specimen drift cancellation. Measure-by-Wire is discussed in depth, and its methodology is illustrated through two detailed examples: the design of a defocus regulator, a type of feedback controller that is akin to existing auto-focus procedures; and an adaptive specimen drift compensator.

[1]  Hartmut Logemann,et al.  PID control of second-order systems with hysteresis , 2008, Int. J. Control.

[2]  Joachim Frank,et al.  Electron Tomography , 1992, Springer US.

[3]  N. Bonnet,et al.  Which image parameter(s) for the automation of the electron microscope? , 1989, Journal of electron microscopy technique.

[4]  G. Tendeloo,et al.  Three-dimensional atomic imaging of crystalline nanoparticles , 2011, Nature.

[5]  Arturo Tejada,et al.  The role of Poisson's binomial distribution in the analysis of TEM images. , 2011, Ultramicroscopy.

[6]  J. Miao,et al.  Electron tomography at 2.4-ångström resolution , 2012, Nature.

[7]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[8]  Norman S. Nise,et al.  Control Systems Engineering , 1991 .

[9]  Ondrej L. Krivanek,et al.  Towards sub-Å electron beams , 1999 .

[10]  Marc De Graef,et al.  Introduction to Conventional Transmission Electron Microscopy: Defects in crystals , 2003 .

[11]  John T. L. Thong,et al.  HIGH-SPEED OPERATION OF SCANNING ELECTRON MICROSCOPE LENSES , 1997 .

[12]  P. Midgley,et al.  Three-Dimensional Nanoparticle Distribution and Local Curvature of Heterogeneous Catalysts Revealed by Electron Tomography , 2007 .

[13]  Stefano Lenci,et al.  Philosophical Transactions: Mathematical, Physical and Engineering Sciences (Series A): Introduction , 2006 .

[14]  Arturo Tejada,et al.  Introducing measure-by-wire, the systematic use of systems and control theory in transmission electron microscopy. , 2011, Ultramicroscopy.

[15]  N. Browning,et al.  The Evolution of Ultrafast Electron Microscope Instrumentation , 2009, Microscopy and Microanalysis.

[16]  Abraham J. Koster,et al.  Virtual nanoscopy: Generation of ultra-large high resolution electron microscopy maps , 2012, The Journal of cell biology.

[17]  Hiroshi Kakibayashi,et al.  Chapter 4 – Hitachi's Development of Cold-Field Emission Scanning Transmission Electron Microscopes , 2009 .

[18]  B Rieger,et al.  Electronic Reprint Biological Crystallography a Toolkit for the Characterization of Ccd Cameras for Transmission Electron Microscopy Biological Crystallography a Toolkit for the Characterization of Ccd Cameras for Transmission Electron Microscopy , 2022 .

[19]  C.M.M. van Lierop,et al.  Control-Oriented Hysteresis Models for Magnetic Electron Lenses , 2009 .

[20]  Kazuo Ishizuka,et al.  Coma-free alignment of a high-resolution electron microscope with three-fold astigmatism , 1994 .

[21]  R. P. G. Collinson,et al.  Fly-by-wire flight control , 1999 .

[22]  Piet M. T. Broersen,et al.  Automatic spectral analysis with time series models , 2002, IEEE Trans. Instrum. Meas..

[23]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[24]  S. Erlandsen,et al.  Microscopy Society of America , 2002, Microscopy and Microanalysis.

[25]  P. Luther Sample Shrinkage and Radiation Damage , 1992 .

[26]  J. Plitzko,et al.  Quantitative thin film analysis by energy filtering transmission electron microscopy , 1999 .

[27]  William H. Press,et al.  Numerical recipes in C , 2002 .

[28]  C. Jia,et al.  Negative spherical aberration ultrahigh-resolution imaging in corrected transmission electron microscopy , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[29]  W Van den Broek,et al.  Throughput maximization of particle radius measurements through balancing size versus current of the electron probe. , 2011, Ultramicroscopy.

[30]  George E. P. Box,et al.  Time Series Analysis: Forecasting and Control , 1977 .

[31]  Juri Barthel,et al.  Aberration measurement in HRTEM: implementation and diagnostic use of numerical procedures for the highly precise recognition of diffractogram patterns. , 2010, Ultramicroscopy.

[32]  K. Furuya,et al.  Development and Application of an Internet Electron Microscopy System for the Outreach Program in Japan , 2008, Microscopy and Microanalysis.

[33]  Michael T Snella Drift correction for scanning-electron microscopy , 2010 .

[34]  M. Antonietti,et al.  Promises and problems of mesoscale materials chemistry or why meso? , 2004, Chemistry.

[35]  Ian Postlethwaite,et al.  Multivariable Feedback Control: Analysis and Design , 1996 .

[36]  M. Gibson,et al.  Study of quadrupole-octopole Cc corrector for the large gap HREM , 2001 .

[37]  John M. Cowley,et al.  The simulation of high resolution images of amorphous thin films , 1987 .

[38]  R. Pepperkok,et al.  The potential of high‐content high‐throughput microscopy in drug discovery , 2007, British journal of pharmacology.

[39]  N. J. Zaluzec,et al.  Telepresence microscopy and the ANL labspace. , 1996 .

[40]  M. Oheim High‐throughput microscopy must re‐invent the microscope rather than speed up its functions , 2007, British journal of pharmacology.

[41]  Arturo Tejada,et al.  Defocus Polar rOse Estimation Method (POEM): A Fast Defocus Estimation Method for STEM , 2012, IEEE Transactions on Instrumentation and Measurement.

[42]  W. O. Saxton,et al.  A new way of measuring microscope aberrations , 2000, Ultramicroscopy.

[43]  Stephen P. Boyd,et al.  Future directions in control in an information-rich world , 2003 .

[44]  Dong-Hua Chen,et al.  Estimating contrast transfer function and associated parameters by constrained non‐linear optimization , 2009, Journal of microscopy.

[45]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[46]  P D Nellist,et al.  Progress in aberration-corrected scanning transmission electron microscopy. , 2001, Journal of electron microscopy.

[47]  P. Laycock,et al.  Optimum Experimental Designs , 1995 .

[48]  J. Doyle,et al.  Robust and optimal control , 1995, Proceedings of 35th IEEE Conference on Decision and Control.

[49]  S. Marco,et al.  Electron tomography of biological samples , 2004, Biochemistry (Moscow).

[50]  D. Van Dyck,et al.  Maximum likelihood estimation of structure parameters from high resolution electron microscopy images. Part I: a theoretical framework. , 2005 .

[51]  Frank Natterer,et al.  Mathematical methods in image reconstruction , 2001, SIAM monographs on mathematical modeling and computation.

[52]  U. Eigenthaler,et al.  Plasmon energy mapping in energy-filtering transmission electron microscopy. , 2003, Ultramicroscopy.

[53]  David B. Williams,et al.  Transmission Electron Microscopy: A Textbook for Materials Science , 1996 .

[54]  H. Sawada,et al.  Measurement method of aberration from Ronchigram by autocorrelation function. , 2008, Ultramicroscopy.

[55]  W. Wonham,et al.  Supervisory control of timed discrete-event systems , 1994, IEEE Trans. Autom. Control..

[56]  Stephan Uhlemann,et al.  A spherical-aberration-corrected 200 kV transmission electron microscope , 1998 .

[57]  J Pulokas,et al.  Improving the positional accuracy of the goniometer on the Philips CM series TEM. , 1999, Journal of structural biology.

[58]  Adriaan van den Bos,et al.  High-resolution electron microscopy: from imaging toward measuring , 2002, IEEE Trans. Instrum. Meas..

[59]  P. Midgley,et al.  3D electron microscopy in the physical sciences: the development of Z-contrast and EFTEM tomography. , 2003, Ultramicroscopy.

[60]  Roan Westerhof A survey of literature on controller scheduling , 2000 .

[61]  D. Van Dyck,et al.  Optimal experimental design of STEM measurement of atom column positions. , 2002 .

[62]  Petre Stoica,et al.  Decentralized Control , 2018, The Control Systems Handbook.

[63]  J. E. Barth,et al.  Addition of different contributions to the charged particle probe size , 1996 .

[64]  A. Koster,et al.  Practical autoalignment of transmission electron microscopes , 1992 .

[65]  Avinash C. Kak,et al.  Principles of computerized tomographic imaging , 2001, Classics in applied mathematics.

[66]  G. Birrell,et al.  Biological applications of photoelectron imaging: a practical perspective. , 1991, Ultramicroscopy.

[67]  D. Mastronarde,et al.  A Computational Framework for Ultrastructural Mapping of Neural Circuitry , 2009, PLoS biology.

[68]  J. Stöhr,et al.  Study of Ferromagnet-Antiferromagnet Interfaces Using X-Ray PEEM , 2005 .

[69]  W. Coene,et al.  Improved methods for the determination of the spherical aberration coefficient in high-resolution electron microscopy from micrographs of an amorphous object , 1991 .

[70]  R. Mattheij,et al.  Defocus and twofold astigmatism correction in HAADF-STEM. , 2011, Ultramicroscopy.

[71]  P. Goos,et al.  Model-based electron microscopy : from images toward precise numbers for unknown structure parameters , 2012 .

[72]  J Ringnalda,et al.  Breaking the spherical and chromatic aberration barrier in transmission electron microscopy. , 2005, Ultramicroscopy.

[73]  Toivo T. Kodas,et al.  Aerosol Processing of Materials , 1998 .

[74]  L. Reimer Scanning Electron Microscopy: Physics of Image Formation and Microanalysis , 1984 .

[75]  F Haguenau,et al.  Key Events in the History of Electron Microscopy , 2003, Microscopy and Microanalysis.

[76]  Arturo Tejada,et al.  Towards an adaptive minimum variance control scheme for specimen drift compensation in transmission electron microscopes , 2011, The 2011 International Workshop on Multidimensional (nD) Systems.

[77]  M H Ellisman,et al.  Web-based telemicroscopy. , 1999, Journal of structural biology.

[78]  S. Bals,et al.  A practical method to determine the effective resolution in incoherent experimental electron tomography. , 2011, Ultramicroscopy.

[79]  O. Krivanek,et al.  Three-fold astigmatism in high-resolution transmission electron microscopy , 1994 .

[80]  David Rijlaarsdam,et al.  Nonlinearities in Industrial motion stages - detection and classification , 2010, Proceedings of the 2010 American Control Conference.

[81]  L.G. Bushnell On the History of Control , 1996, IEEE Control Systems.

[82]  C. Kübel,et al.  Recent Advances in Electron Tomography: TEM and HAADF-STEM Tomography for Materials Science and Semiconductor Applications , 2005, Microscopy and Microanalysis.

[83]  O. Krivanek A method for determining the coefficient of spherical aberration from a single electron micrograph , 1976 .

[84]  Karl Johan Åström,et al.  Adaptive Control , 1989, Embedded Digital Control with Microcontrollers.

[85]  Harold Klee,et al.  Simulation of Dynamic Systems with MATLAB and Simulink , 2007 .

[86]  Steven T Peltier,et al.  Characterization of a direct detection device imaging camera for transmission electron microscopy. , 2010, Ultramicroscopy.

[87]  Arturo Tejada,et al.  A comparison between minimum variance control and other online compensation methods for specimen drift in transmission electron microscopy , 2014, Multidimens. Syst. Signal Process..

[88]  W. K. Brown,et al.  Derivation of the Weibull distribution based on physical principles and its connection to the Rosin–Rammler and lognormal distributions , 1995 .

[89]  J. Spence High-Resolution Electron Microscopy , 2003 .

[90]  Arturo Tejada,et al.  Towards STEM control: Modeling framework and development of a sensor for defocus control , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[91]  Piet M. T. Broersen,et al.  Automatic Autocorrelation and Spectral Analysis , 2006 .

[92]  L. Reimer,et al.  Scanning Electron Microscopy , 1984 .

[93]  P D Nellist,et al.  Aberration measurement using the Ronchigram contrast transfer function. , 2010, Ultramicroscopy.

[94]  David J. Smith,et al.  Procedures for focusing, stigmating and alignment in high resolution electron microscopy , 1983 .

[95]  N. Baba,et al.  An “on-line” correction method of defocus and astigmatism in HAADF-STEM , 1999 .

[96]  S. V. Aert,et al.  Statistiscal Experimental Design for Quantitative Atomic Resolution Transmission Electron Microscopy , 2003 .