A Review of Computer Microvision-Based Precision Motion Measurement: Principles, Characteristics, and Applications

Microengineering/nanoengineering is an emerging field that enables engineering and scientific discoveries in the microworld. As an effective and powerful tool for automation and manipulation at small scales, precision motion measurement by computer microvision is now broadly accepted and widely used in microengineering/nanoengineering. Unlike other measurement methods, the vision-based techniques can intuitively visualize the measuring process with high interactivity, expansibility, and flexibility. This article aims to comprehensively present a survey of microvision-based motion measurement from the collective experience. Working principles of microvision systems are first introduced and described, where the hardware configuration, model calibration, and motion measurement algorithms are systematically summarized. The characteristics and performances of different microvision-based methods are then analyzed and discussed in terms of measurement resolution, range, degree of freedom, efficiency, and error sources. Recent advances of applications empowered by the developed computer microvision-based methods are also presented. The review can be helpful to researchers who engage in the development of microvision-based techniques and provide the recent state and tendency for the research community of vision-based measurement, manipulation, and automation at microscale/nanoscale.

[1]  Georgios Tzimiropoulos,et al.  Frequency domain subpixel registration using HOG phase correlation , 2017, Comput. Vis. Image Underst..

[2]  Tobias Tiemerding,et al.  Automated Robotic Manipulation of Individual Colloidal Particles Using Vision-Based Control , 2015, IEEE/ASME Transactions on Mechatronics.

[3]  Brandon K. Chen,et al.  A Closed-Loop Controlled Nanomanipulation System for Probing Nanostructures Inside Scanning Electron Microscopes , 2016, IEEE/ASME Transactions on Mechatronics.

[4]  Zhong Chen,et al.  Realtime in-plane displacements tracking of the precision positioning stage based on computer micro-vision , 2019 .

[5]  Xianmin Zhang,et al.  A monocular vision system for online pose measurement of a 3RRR planar parallel manipulator , 2018, J. Intell. Robotic Syst..

[6]  Dong Li,et al.  An accurate calibration method for a camera with telecentric lenses , 2013 .

[7]  Natan Peterfreund,et al.  Robust Tracking of Position and Velocity With Kalman Snakes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  S. Tans,et al.  High-throughput 3D tracking of bacteria on a standard phase contrast microscope , 2015, Nature Communications.

[9]  Yong Zhang,et al.  Automated Four-Point Probe Measurement of Nanowires Inside a Scanning Electron Microscope , 2011, IEEE Transactions on Nanotechnology.

[10]  Takeo Kanade,et al.  Cell population tracking and lineage construction with spatiotemporal context , 2008, Medical Image Anal..

[11]  Joshua W. Shaevitz,et al.  Efficient Multiple Object Tracking Using Mutually Repulsive Active Membranes , 2012, PloS one.

[12]  M. Młynarczuk,et al.  Evaluation of Local Matching Methods in Image Analysis for Mineral Grain Tracking in Microscope Images of Rock Sections , 2018 .

[13]  Daniel Jasper High-speed position tracking for nanohandling inside scanning electron microscopes , 2009, 2009 IEEE International Conference on Robotics and Automation.

[14]  Shaorong Xie,et al.  Robotic Adherent Cell Injection for Characterizing Cell–Cell Communication , 2015, IEEE Transactions on Biomedical Engineering.

[15]  A. Ferreira,et al.  Automatic microassembly system assisted by vision servoing and virtual reality , 2004, IEEE/ASME Transactions on Mechatronics.

[16]  Hui Tang,et al.  A Novel Self-Feedback Intelligent Vision Measure for Fast and Accurate Alignment in Flip-Chip Packaging , 2020, IEEE Transactions on Industrial Informatics.

[17]  T. Baer,et al.  Non-invasive imaging of human embryos before embryonic genome activation predicts development to the blastocyst stage , 2010, Nature Biotechnology.

[18]  Yong Zhang,et al.  An Improved Visual Tracking Method in Scanning Electron Microscope , 2012, Microscopy and Microanalysis.

[19]  Sergej Fatikow,et al.  Combined nanorobotic AFM/SEM system as novel toolbox for automated hybrid analysis and manipulation of nanoscale objects , 2010, 2010 IEEE International Conference on Robotics and Automation.

[20]  Laurent Robert,et al.  Position-referenced microscopy for live cell culture monitoring , 2011, Biomedical optics express.

[21]  J. Lichtman,et al.  Optical sectioning microscopy , 2005, Nature Methods.

[22]  Donald B. Hondongwa,et al.  A Review of the Pinned Photodiode for CCD and CMOS Image Sensors , 2014, IEEE Journal of the Electron Devices Society.

[23]  Yang Li,et al.  Random residual neural network-based nanoscale positioning measurement. , 2020, Optics express.

[24]  Rama Chellappa,et al.  Model-based temporal object verification using video , 2001, IEEE Trans. Image Process..

[25]  Xianmin Zhang,et al.  A novel microgripper hybrid driven by a piezoelectric stack actuator and piezoelectric cantilever actuators. , 2016, The Review of scientific instruments.

[26]  Xianmin Zhang,et al.  High-Accuracy Calibration of a Visual Motion Measurement System for Planar 3-DOF Robots Using Gaussian Process , 2019, IEEE Sensors Journal.

[27]  Ernst Meyer,et al.  Scanning Probe Microscopy: The Lab on a Tip , 2021 .

[28]  Gordon Morison,et al.  Extended fast compressive tracking with weighted multi-frame template matching for fast motion tracking , 2016, Pattern Recognit. Lett..

[29]  Azriel Rosenfeld,et al.  Picture Processing by Computer , 1969, CSUR.

[30]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[31]  Sergej Fatikow,et al.  Real-time object tracking for the robot-based nanohandling in a scanning electron microscope , 2006 .

[32]  Tao Chen,et al.  Visual Servoing-Based Nanorobotic System for Automated Electrical Characterization of Nanotubes inside SEM , 2018, Sensors.

[33]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Xianmin Zhang,et al.  Design of compliant mechanisms using continuum topology optimization: A review , 2020 .

[35]  Bijan Shirinzadeh,et al.  Laser-Based Sensing, Measurement, and Misalignment Control of Coupled Linear and Angular Motion for Ultrahigh Precision Movement , 2015, IEEE/ASME Transactions on Mechatronics.

[36]  Éric Marchand,et al.  Calibration of scanning electron microscope using a multi-image non-linear minimization process , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[37]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[38]  Zhong Chen,et al.  Telecentric stereo micro-vision system: Calibration method and experiments , 2014 .

[39]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[40]  Yu Sun,et al.  Nano-dissection and sequencing of DNA at single sub-nuclear structures. , 2014, Small.

[41]  Long Quan,et al.  Self-calibration of an affine camera from multiple views , 1996, International Journal of Computer Vision.

[42]  David Mas,et al.  Realistic limits for subpixel movement detection. , 2016, Applied optics.

[43]  Jean-Marc Breguet,et al.  Nanomanipulation in a scanning electron microscope , 2005 .

[44]  A. Bazaei,et al.  Combining Spiral Scanning and Internal Model Control for Sequential AFM Imaging at Video Rate , 2017, IEEE/ASME Transactions on Mechatronics.

[45]  Bing Pan,et al.  Bias error reduction of digital image correlation using Gaussian pre-filtering , 2013 .

[46]  Jun Liu,et al.  Recent advances in nanorobotic manipulation inside scanning electron microscopes , 2016, Microsystems & Nanoengineering.

[47]  Zhenyu Jiang,et al.  Path-independent digital image correlation with high accuracy, speed and robustness , 2015 .

[48]  Bo Wang,et al.  Moment Matching for Multi-Source Domain Adaptation , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[49]  Michael T. Orchard,et al.  A fast direct Fourier-based algorithm for subpixel registration of images , 2001, IEEE Trans. Geosci. Remote. Sens..

[50]  Andreas K. Maier,et al.  Automatic Cell Detection in Bright-Field Microscope Images Using SIFT, Random Forests, and Hierarchical Clustering , 2013, IEEE Transactions on Medical Imaging.

[51]  G. Danilatos,et al.  Theory of the Gaseous Detector Device in the Environmental Scanning Electron Microscope , 1990 .

[52]  Hai Helen Li,et al.  Single grid image based calibration of an optical microscope , 2017, 2017 International Conference on Manipulation, Automation and Robotics at Small Scales (MARSS).

[53]  Vijay Kumar,et al.  A two dimensional vision-based force sensor for microrobotic applications , 2011 .

[54]  Michael A. Sutton,et al.  Advances in light microscope stereo vision , 2004 .

[55]  Dong Sun,et al.  A Force Control Approach to a Robot-assisted Cell Microinjection System , 2010, Int. J. Robotics Res..

[56]  Sounkalo Dembélé,et al.  Fast image drift compensation in scanning electron microscope using image registration , 2013, 2013 IEEE International Conference on Automation Science and Engineering (CASE).

[57]  Edward Grant,et al.  Blastocyst Microinjection Automation , 2009, IEEE Transactions on Information Technology in Biomedicine.

[58]  Xianmin Zhang,et al.  Micro-motion detection of the 3-DOF precision positioning stage based on iterative optimized template matching. , 2017, Applied optics.

[59]  Dong Hwan Kim,et al.  Image improvement with modified scanning waves and noise reduction in a scanning electron microscope , 2010 .

[60]  Bradley J. Nelson,et al.  Real-time Rigid-body Visual Tracking in a Scanning Electron Microscope , 2007, 2007 7th IEEE Conference on Nanotechnology (IEEE NANO).

[61]  G. E. Smith,et al.  Charge coupled semiconductor devices , 1970, Bell Syst. Tech. J..

[62]  David Zhang,et al.  A Level Set Approach to Image Segmentation With Intensity Inhomogeneity , 2016, IEEE Transactions on Cybernetics.

[63]  Jitendra Malik,et al.  Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[64]  Maria Q. Feng,et al.  Computer vision for SHM of civil infrastructure: From dynamic response measurement to damage detection – A review , 2018 .

[65]  Yu Sun,et al.  Orientation Control of Biological Cells Under Inverted Microscopy , 2011, IEEE/ASME Transactions on Mechatronics.

[66]  Kevin W Eliceiri,et al.  Laser scanning confocal microscopy: history, applications, and related optical sectioning techniques. , 2014, Methods in molecular biology.

[67]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[68]  Takeo Kanade,et al.  Cell Population Tracking and Lineage Construction with Spatiotemporal Context , 2007, MICCAI.

[69]  Sergej Fatikow,et al.  Pose Sensing and Servo Control of the Compliant Nanopositioners Based on Microscopic Vision , 2021, IEEE Transactions on Industrial Electronics.

[70]  Xianmin Zhang,et al.  A magnification-continuous calibration method for SEM-based nanorobotic manipulation systems. , 2019, The Review of scientific instruments.

[71]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[72]  Xianmin Zhang,et al.  Multi-target tracking for automated RF on-wafer probing based on template matching , 2019, 2019 International Conference on Manipulation, Automation and Robotics at Small Scales (MARSS).

[73]  Joshua M. Pearce,et al.  Free and open‐source automated 3‐D microscope , 2016, Journal of microscopy.

[74]  Hideki Yamamoto,et al.  Study of micromanipulation using stereoscopic microscope , 2002, IEEE Trans. Instrum. Meas..

[75]  Jun Luo,et al.  Locating End-Effector Tips in Robotic Micromanipulation , 2014, IEEE Transactions on Robotics.

[76]  Bradley J Nelson,et al.  Autofocusing in computer microscopy: Selecting the optimal focus algorithm , 2004, Microscopy research and technique.

[77]  Sounkalo Dembélé,et al.  Image-Guided Nanopositioning Scheme for SEM , 2018, IEEE Transactions on Automation Science and Engineering.

[78]  Yi Zhang,et al.  Gradient-based subspace phase correlation for fast and effective image alignment , 2014, J. Vis. Commun. Image Represent..

[79]  S Choi,et al.  Development of a high speed laser scanning confocal microscope with an acquisition rate up to 200 frames per second. , 2013, Optics express.

[80]  Michael T Snella Drift correction for scanning-electron microscopy , 2010 .

[81]  Xianmin Zhang,et al.  Full closed-loop controls of micro/nano positioning system with nonlinear hysteresis using micro-vision system , 2017 .

[82]  Sergej Fatikow,et al.  Development of a microrobot-based micromanipulation cell in a scanning electron microscope (SEM) , 2000, SPIE Optics East.

[83]  William Scott Hoge,et al.  A subspace identification extension to the phase correlation method [MRI application] , 2003, IEEE Transactions on Medical Imaging.

[84]  Peisen S Huang,et al.  A vision-based method for planar position measurement , 2016 .

[85]  M. E. Nia,et al.  Adaptive noise Wiener filter for scanning electron microscope imaging system. , 2016, Scanning.

[86]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[87]  Wanfeng Shang,et al.  Vision-based Nano Robotic System for High-throughput Non-embedded Cell Cutting , 2016, Scientific reports.

[88]  Mingyu Liu,et al.  Integrated polar microstructure and template-matching method for optical position measurement. , 2018, Optics express.

[89]  Toshio Fukuda,et al.  Development of the auto manipulation system towards the single cell automatic analysis inside an environmental SEM , 2012, 2012 IEEE International Conference on Robotics and Automation.

[90]  S. Fericean,et al.  New Noncontacting Inductive Analog Proximity and Inductive Linear Displacement Sensors for Industrial Automation , 2007, IEEE Sensors Journal.

[91]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[92]  Sang Uk Lee,et al.  Robust image watermarking using local Zernike moments , 2009, J. Vis. Commun. Image Represent..

[93]  James K Mills,et al.  Cell extraction automation in single cell surgery using the displacement method , 2019, Biomedical microdevices.

[94]  Philippe Lutz,et al.  Photo-Robotic Positioning for Integrated Optics , 2017, IEEE Robotics and Automation Letters.

[95]  Lirong Qiu,et al.  Three-dimensional super-resolution correlation-differential confocal microscopy with nanometer axial focusing accuracy. , 2018, Optics express.

[96]  Yohsuke Imai,et al.  Measurement of Individual Red Blood Cell Motions Under High Hematocrit Conditions Using a Confocal Micro-PTV System , 2009, Annals of Biomedical Engineering.

[97]  Yong Wang,et al.  Automated Translational and Rotational Control of Biological Cells With a Robot-Aided Optical Tweezers Manipulation System , 2016, IEEE Transactions on Automation Science and Engineering.

[98]  Sounkalo Dembélé,et al.  Full 3D rotation estimation in scanning electron microscope , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[99]  Patrick Sandoz,et al.  Subpixelic Measurement of Large 1D Displacements: Principle, Processing Algorithms, Performances and Software , 2014, Sensors.

[100]  Xianmin Zhang,et al.  Displacement measurement of the compliant positioning stage based on a computer micro-vision method , 2016 .

[101]  Shidong Song,et al.  Research on an Automatic Tracking Strategy Based on CCD Image Sensor in Micromanipulation , 2018, IEEE Access.

[102]  S. Gedam,et al.  Area Based Image Matching Methods – A Survey , 2012 .

[103]  Haibo Liu,et al.  A Flexible Calibration Approach for Cameras with Double-Sided Telecentric Lenses , 2016 .

[104]  Anand Asundi,et al.  Two-dimensional digital image correlation for in-plane displacement and strain measurement: a review , 2009 .

[105]  Hiroaki Kawata,et al.  Optical projection lithography using lenses with numerical apertures greater than unity , 1989 .

[106]  Xianmin Zhang,et al.  Online Precise Motion Measurement of 3-DOF Nanopositioners Based on Image Correlation , 2019, IEEE Transactions on Instrumentation and Measurement.

[107]  Ludwig Josef Balk,et al.  A universal scanning-probe-microscope-based hybrid system , 2003 .

[108]  M. Shah,et al.  Object tracking: A survey , 2006, CSUR.

[109]  Hiroshi Tsuda,et al.  Accurate full-field optical displacement measurement technique using a digital camera and repeated patterns. , 2014, Optics express.

[110]  Shang-Hong Lai,et al.  Fast Template Matching Based on Normalized Cross Correlation With Adaptive Multilevel Winner Update , 2008, IEEE Transactions on Image Processing.

[111]  Darius Burschka,et al.  Adaptive and Generic Corner Detection Based on the Accelerated Segment Test , 2010, ECCV.

[112]  S. Maraghechi,et al.  Correction of Scanning Electron Microscope Imaging Artifacts in a Novel Digital Image Correlation Framework , 2019, Experimental Mechanics.

[113]  A. Asundi,et al.  Digital image correlation using iterative least squares and pointwise least squares for displacement field and strain field measurements , 2009 .

[114]  Satyandra K. Gupta,et al.  Automated Manipulation of Biological Cells Using Gripper Formations Controlled By Optical Tweezers , 2014, IEEE Transactions on Automation Science and Engineering.

[115]  B. Dong,et al.  Ultrasensitive video extensometer using single-camera dual field-of-view telecentric imaging system. , 2019, Optics letters.

[116]  Tong Guo,et al.  Micro-motion analyzer used for dynamic MEMS characterization , 2009 .

[117]  Peng Yan,et al.  Efficient block matching using improved particle swarm optimization with application to displacement measurement for nano motion systems , 2018 .

[118]  Tony Lindeberg,et al.  Image Matching Using Generalized Scale-Space Interest Points , 2013, Journal of Mathematical Imaging and Vision.

[119]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[120]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[121]  Xing Wang,et al.  High-accuracy and real-time 3D positioning, tracking system for medical imaging applications based on 3D digital image correlation , 2017 .

[122]  Patrick Sandoz,et al.  3D-printed vision-based micro-force sensor dedicated to in situ SEM measurements , 2017, 2017 IEEE International Conference on Advanced Intelligent Mechatronics (AIM).

[123]  S. Peng,et al.  Partial least squares and random sample consensus in outlier detection. , 2012, Analytica chimica acta.

[124]  Sergej Fatikow,et al.  An Improved Template-Matching-Based Pose Tracking Method for Planar Nanopositioning Stages Using Enhanced Correlation Coefficient , 2020, IEEE Sensors Journal.

[125]  Jianyu Yang,et al.  A Computationally Efficient Particle Filter for Multitarget Tracking Using an Independence Approximation , 2013, IEEE Transactions on Signal Processing.

[126]  Xianmin Zhang,et al.  Optimal design of a planar parallel 3-DOF nanopositioner with multi-objective , 2017 .

[127]  Toshio Fukuda,et al.  Contact assembly of cell-laden hollow microtubes through automated micromanipulator tip locating , 2016 .

[128]  G. Ravichandran,et al.  Three-dimensional Full-field Measurements of Large Deformations in Soft Materials Using Confocal Microscopy and Digital Volume Correlation , 2007 .

[129]  B. Nelson,et al.  Calibration of a parametric model of an optical microscope , 1999 .

[130]  Tom Drummond,et al.  Fusing points and lines for high performance tracking , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[131]  Alberto Mínguez Martínez,et al.  Industrial Calibration Procedure for Confocal Microscopes , 2019, Materials.

[132]  Xianmin Zhang,et al.  Displacement measurement system for inverters using computer micro-vision , 2016 .

[133]  Xiaoqin Zhang,et al.  Active Contour-Based Visual Tracking by Integrating Colors, Shapes, and Motions , 2013, IEEE Transactions on Image Processing.

[134]  Adam S. Backer,et al.  Optimal point spread function design for 3D imaging. , 2014, Physical review letters.

[135]  Tobias Tiemerding,et al.  Fast and robust position determination in the scanning electron microscope , 2013 .

[136]  Patrick Sandoz,et al.  2D visual micro-position measurement based on intertwined twin-scale patterns , 2016 .

[137]  Bradley J. Nelson,et al.  Biological Cell Injection Using an Autonomous MicroRobotic System , 2002, Int. J. Robotics Res..

[138]  Iasonas Kokkinos,et al.  Discriminative Learning of Deep Convolutional Feature Point Descriptors , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[139]  Qingsong Xu,et al.  A review on actuation and sensing techniques for MEMS-based microgrippers , 2017 .

[140]  Éric Marchand,et al.  CAD Model-based Tracking and 3D Visual-based Control for MEMS Microassembly , 2010, Int. J. Robotics Res..

[141]  Xianmin Zhang,et al.  Parameters Optimization and Experiment of A Planar Parallel 3-DOF Nanopositioning System , 2018, IEEE Transactions on Industrial Electronics.

[142]  Peng Xu,et al.  Optical nanoscale positioning measurement with a feature-based method , 2020 .

[143]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[144]  Sounkalo Dembélé,et al.  Scanning electron microscope image signal-to-noise ratio monitoring for micro-nanomanipulation. , 2014, Scanning.

[145]  Bradley J. Nelson,et al.  Micropositioning of a weakly calibrated microassembly system using coarse-to-fine visual servoing strategies , 2000 .

[146]  A. Nehorai,et al.  Deconvolution methods for 3-D fluorescence microscopy images , 2006, IEEE Signal Processing Magazine.

[147]  Sergej Fatikow,et al.  Micro-force sensing in a micro-robotic system , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[148]  Y. Novikov Calibration of a scanning electron microscope from two coordinates , 2017, Journal of Surface Investigation: X-ray, Synchrotron and Neutron Techniques.

[149]  Shree K. Nayar,et al.  Telecentric Optics for Focus Analysis , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[150]  Slava Krylov,et al.  Nanoscale displacement measurement of electrostatically actuated micro-devices using optical microscopy and digital image correlation , 2010 .

[151]  G. Danilatos Foundations of Environmental Scanning Electron Microscopy , 1988 .

[152]  Trevor T. Ashley,et al.  Tracking single fluorescent particles in three dimensions via extremum seeking. , 2016, Biomedical optics express.

[153]  Dongsheng Zhang,et al.  Robust full-field measurement considering rotation using digital image correlation , 2016 .

[154]  Chen Wang,et al.  Procedure for Calibrating the Z-axis of a Confocal Microscope: Application for the Evaluation of Structured Surfaces , 2019, Sensors.

[155]  Bijan Shirinzadeh,et al.  A Vision-Based Methodology to Dynamically Track and Describe Cell Deformation during Cell Micromanipulation , 2013 .

[156]  Carmine Clemente,et al.  A novel algorithm for radar classification based on doppler characteristics exploiting orthogonal Pseudo-Zernike polynomials , 2015, IEEE Transactions on Aerospace and Electronic Systems.

[157]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.

[158]  Roland Göcke,et al.  Optical flow estimation using Fourier Mellin Transform , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[159]  Mohsen Ebrahimi Moghaddam,et al.  A hybrid occlusion free object tracking method using particle filter and modified galaxy based search meta-heuristic algorithm , 2017, Appl. Soft Comput..

[160]  Chenggen Quan,et al.  Digital image correlation in polar coordinate robust to a large rotation , 2017 .

[161]  Li Li,et al.  Visual Servoed Zebrafish Larva Heart Microinjection System , 2017, IEEE Transactions on Industrial Electronics.

[162]  Roberto Cipolla,et al.  Real-Time Visual Tracking of Complex Structures , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[163]  Michael A. Sutton,et al.  The effect of out-of-plane motion on 2D and 3D digital image correlation measurements , 2008 .

[164]  Sergej Fatikow,et al.  3-D Vision Feedback for Nanohandling Monitoring in a Scanning Electron Microscope , 2007 .

[165]  Lu Ren,et al.  Vision-Based 2-D Automatic Micrograsping Using Coarse-to-Fine Grasping Strategy , 2008, IEEE Transactions on Industrial Electronics.

[166]  Hui Xie,et al.  High-Speed AFM Imaging of Nanopositioning Stages Using H$_{\infty }$ and Iterative Learning Control , 2020, IEEE Transactions on Industrial Electronics.

[167]  Peter C. Y. Chen,et al.  Force Sensing and Control in Micromanipulation , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[168]  David B. Dusenbery,et al.  Living at Micro Scale: The Unexpected Physics of Being Small , 2009 .

[169]  Jacob D. Hochhalter,et al.  Increasing accuracy and precision of digital image correlation through pattern optimization , 2017 .

[170]  Nathan J. Mudrak,et al.  Calibrated brightfield‐based imaging for measuring intracellular protein concentration , 2018, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[171]  Sergej Fatikow Automated nanohandling by microrobots , 2008 .

[172]  Casper van der Wel,et al.  Automated tracking of colloidal clusters with sub-pixel accuracy and precision , 2016, Journal of physics. Condensed matter : an Institute of Physics journal.

[173]  Takeshi Takaki,et al.  High-Frame-Rate Optical Flow System , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[174]  Bijan Shirinzadeh,et al.  Vision-based force measurement using neural networks for biological cell microinjection. , 2014, Journal of biomechanics.

[175]  James K. Mills,et al.  Visual measurement of MEMS microassembly forces using template matching , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[176]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[177]  Enrico Savio,et al.  Critical factors in SEM 3D stereo microscopy , 2008 .

[178]  Yangmin Li,et al.  Visual Servo Feedback Control of a Novel Large Working Range Micro Manipulation System for Microassembly , 2014, Journal of Microelectromechanical Systems.

[179]  Xin Zhao,et al.  Robotic Cell Rotation Based on the Minimum Rotation Force , 2015, IEEE Transactions on Automation Science and Engineering.

[180]  Helder Araújo,et al.  Calibration of Smooth Camera Models , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[181]  Zhongwei Li,et al.  A Framework to Calibrate the Scanning Electron Microscope Under Variational Magnifications , 2016, IEEE Photonics Technology Letters.

[182]  Xianmin Zhang,et al.  High-precision displacement measurement method for three degrees of freedom-compliant mechanisms based on computer micro-vision. , 2016, Applied optics.

[183]  Toshio Fukuda,et al.  Direct nano-injection method by nanoprobe insertion based on E-SEM nanorobotic manipulation under hybrid microscope , 2011, 2011 IEEE International Conference on Robotics and Automation.

[184]  James K. Mills,et al.  Cleavage-stage embryo rotation tracking and automated micropipette control: Towards automated single cell manipulation , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[185]  Vasileios Argyriou,et al.  A Study of Sub-pixel Motion Estimation using Phase Correlation , 2006, BMVC.

[186]  Chandan Singh,et al.  Fast and numerically stable methods for the computation of Zernike moments , 2010, Pattern Recognit..

[187]  Xin Chen,et al.  A Flip-Chip Alignment System With the Property of Deviation Self-Correction at the Nanoscale , 2021, IEEE Transactions on Industrial Electronics.

[188]  Jue Wang,et al.  Implementation and evaluation of optical flow methods for two-dimensional deformation measurement in comparison to digital image correlation , 2018, Optics and Lasers in Engineering.

[189]  Zheng Gong,et al.  Robotic Probing of Nanostructures inside Scanning Electron Microscopy , 2014, IEEE Transactions on Robotics.

[190]  Qian Chen,et al.  A new microscopic telecentric stereo vision system - Calibration, rectification, and three-dimensional reconstruction , 2019, Optics and Lasers in Engineering.

[191]  Xinyu Liu,et al.  Cell Contour Tracking and Data Synchronization for Real-Time, High-Accuracy Micropipette Aspiration , 2009, IEEE Transactions on Automation Science and Engineering.

[192]  Xinyu Liu,et al.  Vision-based cellular force measurement using an elastic microfabricated device , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[193]  James M. W. Brownjohn,et al.  Review of machine-vision based methodologies for displacement measurement in civil structures , 2018 .

[194]  Patrick Sandoz,et al.  Sensing One Nanometer Over Ten Centimeters: A Microencoded Target for Visual In-Plane Position Measurement , 2020, IEEE/ASME Transactions on Mechatronics.

[195]  Éric Marchand,et al.  Three-dimensional visual tracking and pose estimation in Scanning Electron Microscopes , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[196]  Bradley J. Nelson,et al.  A CAD model based tracking system for visually guided microassembly , 2005, Robotica.

[197]  Panagiotis Sidiropoulos,et al.  Matching of Large Images Through Coupled Decomposition , 2015, IEEE Transactions on Image Processing.

[198]  M. Sutton,et al.  Scanning Electron Microscopy for Quantitative Small and Large Deformation Measurements Part II: Experimental Validation for Magnifications from 200 to 10,000 , 2007 .

[199]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[200]  Wei Huang,et al.  Displacement measurement with nanoscale resolution using a coded micro-mark and digital image correlation , 2014 .

[201]  Andrea Vedaldi,et al.  HPatches: A Benchmark and Evaluation of Handcrafted and Learned Local Descriptors , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[202]  Mehdi Ammi,et al.  Automatic Camera-Based Microscope Calibration for a Telemicromanipulation System Using a Virtual Pattern , 2009, IEEE Transactions on Robotics.

[203]  Wei Tong,et al.  Fast, Robust and Accurate Digital Image Correlation Calculation Without Redundant Computations , 2013, Experimental Mechanics.

[204]  Huiyang Liao,et al.  Precision Alignment of Optical Fibers Based on Telecentric Stereo Microvision , 2016, IEEE/ASME Transactions on Mechatronics.

[205]  B. N. Chatterji,et al.  An FFT-based technique for translation, rotation, and scale-invariant image registration , 1996, IEEE Trans. Image Process..

[206]  Bing Pan,et al.  High-Accuracy 2D Digital Image Correlation Measurements with Bilateral Telecentric Lenses: Error Analysis and Experimental Verification , 2013 .

[207]  Yudong Zhang,et al.  Tracking features in retinal images of adaptive optics confocal scanning laser ophthalmoscope using KLT-SIFT algorithm , 2010, Biomedical optics express.

[208]  Eric Marchand,et al.  Scanning Electron Microscope Calibration Using a Multi-Image Non-Linear Minimization Process , 2015 .

[209]  Xiaobo Zhou,et al.  Red Blood Cell Tracking Using Optical Flow Methods , 2014, IEEE Journal of Biomedical and Health Informatics.

[210]  Hassan Foroosh,et al.  Extension of phase correlation to subpixel registration , 2002, IEEE Trans. Image Process..

[211]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[212]  Manuel Guizar-Sicairos,et al.  Efficient subpixel image registration algorithms. , 2008, Optics letters.

[213]  Bradley J. Nelson,et al.  Vision-based force measurement , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[214]  Janne Heikkilä,et al.  Pattern matching with affine moment descriptors , 2004, Pattern Recognit..

[215]  Hans P. Moravec Obstacle avoidance and navigation in the real world by a seeing robot rover , 1980 .

[216]  Chia-Hsiang Menq,et al.  Visual Tracking of Six-Axis Motion Rendering Ultraprecise Visual Servoing of Microscopic Objects , 2018, IEEE/ASME Transactions on Mechatronics.

[217]  Sounkalo Dembélé,et al.  Toward Fast Calibration of Global Drift in Scanning Electron Microscopes with Respect to Time and Magnification , 2012 .

[218]  Qingsong Xu,et al.  Design, Fabrication, and Visual Servo Control of an XY Parallel Micromanipulator With Piezo-Actuation , 2009, IEEE Transactions on Automation Science and Engineering.

[219]  Shinichiro Omachi,et al.  Fast Template Matching With Polynomials , 2007, IEEE Transactions on Image Processing.

[220]  Xianmin Zhang,et al.  A high accuracy algorithm of displacement measurement for a micro-positioning stage , 2017 .

[221]  Yusheng Xu,et al.  A Novel Subpixel Phase Correlation Method Using Singular Value Decomposition and Unified Random Sample Consensus , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[222]  Xiaoyuan He,et al.  Noise robustness and parallel computation of the inverse compositional Gauss-Newton algorithm in digital image correlation , 2015 .

[223]  Federico Tombari,et al.  ZNCC-based template matching using bounded partial correlation , 2004 .

[224]  Dong Sun,et al.  3-D Image Reconstruction of Biological Organelles With a Robot-Aided Microscopy System for Intracellular Surgery , 2019, IEEE Robotics and Automation Letters.

[225]  Larry S. Davis,et al.  Fast multiple object tracking via a hierarchical particle filter , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[226]  Wei Gao,et al.  A six-degree-of-freedom surface encoder for precision positioning of a planar motion stage , 2013 .

[227]  Taiyi Zhang,et al.  Object tracking using an adaptive Kalman filter combined with mean shift , 2010 .

[228]  Xianmin Zhang,et al.  Line-based calibration of a micro-vision motion measurement system , 2017 .

[229]  Zhi-cheng Qiu,et al.  Development of a 3-PRR Precision Tracking System with Full Closed-Loop Measurement and Control , 2019, Sensors.

[230]  Carlos Ortiz-de-Solorzano,et al.  Segmentation and Shape Tracking of Whole Fluorescent Cells Based on the Chan–Vese Model , 2013, IEEE Transactions on Medical Imaging.

[231]  P. Nellist Introduction to Scanning Transmission Electron Microscopy , 2002 .

[232]  H. McNeill,et al.  Intracellular manipulation and measurement with multipole magnetic tweezers , 2019, Science Robotics.

[233]  R. Dobarzić,et al.  [Fluorescence microscopy]. , 1975, Plucne bolesti i tuberkuloza.

[234]  Fib Stage Calibration with Photogrammetric Methods , 2006 .

[235]  L. He,et al.  MEASUREMENT OF MIXED-MODE STRESS INTENSITY FACTORS USING DIGITAL IMAGE CORRELATION METHOD , 2012 .