Real-time visual sensing system achieving high-speed 3D particle tracking with nanometer resolution.

This paper presents a real-time visual sensing system, which is created to achieve high-speed three-dimensional (3D) motion tracking of microscopic spherical particles in aqueous solutions with nanometer resolution. The system comprises a complementary metal-oxide-semiconductor (CMOS) camera, a field programmable gate array (FPGA), and real-time image processing programs. The CMOS camera has high photosensitivity and superior SNR. It acquires images of 128×120 pixels at a frame rate of up to 10,000 frames per second (fps) under the white light illumination from a standard 100 W halogen lamp. The real-time image stream is downloaded from the camera directly to the FPGA, wherein a 3D particle-tracking algorithm is implemented to calculate the 3D positions of the target particle in real time. Two important objectives, i.e., real-time estimation of the 3D position matches the maximum frame rate of the camera and the timing of the output data stream of the system is precisely controlled, are achieved. Two sets of experiments were conducted to demonstrate the performance of the system. First, the visual sensing system was used to track the motion of a 2 μm polystyrene bead, whose motion was controlled by a three-axis piezo motion stage. The ability to track long-range motion with nanometer resolution in all three axes is demonstrated. Second, it was used to measure the Brownian motion of the 2 μm polystyrene bead, which was stabilized in aqueous solution by a laser trapping system.

[1]  A L Stout,et al.  Detection and characterization of individual intermolecular bonds using optical tweezers. , 2001, Biophysical journal.

[2]  Johannes S Kanger,et al.  UvA-DARE ( Digital Academic Repository ) Micro magnetic tweezers for nanomanipulation inside live cells , 2005 .

[3]  Chun-Cheng Huang,et al.  Optical tweezers as sub-pico-newton force transducers , 2001 .

[4]  Jing Wang,et al.  A comparative study of living cell micromechanical properties by oscillatory optical tweezers. , 2008, Optics express.

[5]  E. Stelzer,et al.  Three‐dimensional high‐resolution particle tracking for optical tweezers by forward scattered light , 1999, Microscopy research and technique.

[6]  M. Unser,et al.  A maximum-likelihood formalism for sub-resolution axial localization of fluorescent nanoparticles. , 2005, Optics express.

[7]  Zhipeng Zhang,et al.  Actively Controlled Manipulation of a Magnetic Microbead Using Quadrupole Magnetic Tweezers , 2010, IEEE Transactions on Robotics.

[8]  D E Ingber,et al.  Analysis of cell mechanics in single vinculin-deficient cells using a magnetic tweezer. , 2000, Biochemical and biophysical research communications.

[9]  Chia-Hsiang Menq,et al.  Dynamic Force Sensing Using an Optically Trapped Probing System , 2011, IEEE/ASME Transactions on Mechatronics.

[10]  W. Brownell,et al.  Membrane tether formation from outer hair cells with optical tweezers. , 2002, Biophysical journal.

[11]  K. Neuman,et al.  Single-molecule force spectroscopy: optical tweezers, magnetic tweezers and atomic force microscopy , 2008, Nature Methods.

[12]  Fabian Czerwinski,et al.  High-speed video-based tracking of optically trapped colloids , 2011 .

[13]  Lars Friedrich,et al.  Improved interferometric tracking of trapped particles using two frequency-detuned beams. , 2010, Optics letters.

[14]  Chia-Hsiang Menq,et al.  Three-axis rapid steering of optically propelled micro/nanoparticles. , 2009, The Review of scientific instruments.

[15]  Enrico Gratton,et al.  3D Particle Tracking on a Two-Photon Microscope , 2005, Journal of Fluorescence.

[16]  Charlie Gosse,et al.  Magnetic tweezers: micromanipulation and force measurement at the molecular level. , 2002, Biophysical journal.

[17]  Ulrich F Keyser,et al.  Real-time particle tracking at 10,000 fps using optical fiber illumination. , 2010, Optics express.

[18]  A. Caspi,et al.  Diffusion and directed motion in cellular transport. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[19]  Jan Greve,et al.  Unfolding individual nucleosomes by stretching single chromatin fibers with optical tweezers , 2001, Nature Structural Biology.

[20]  Peter T C So,et al.  Three-dimensional cellular deformation analysis with a two-photon magnetic manipulator workstation. , 2002, Biophysical journal.

[21]  Rafael Piestun,et al.  Three-dimensional parallel particle manipulation and tracking by integrating holographic optical tweezers and engineered point spread functions. , 2011, Optics express.

[22]  Ashley R. Carter,et al.  Back-scattered detection provides atomic-scale localization precision, stability, and registration in 3D. , 2007, Optics express.

[23]  Gwo-Bin Lee,et al.  New magnetic tweezers for investigation of the mechanical properties of single DNA molecules , 2006 .

[24]  Friedrich Kremer,et al.  A novel video-based microsphere localization algorithm for low contrast silica particles under white light illumination , 2012 .

[25]  Vinod Subramaniam,et al.  Intracellular manipulation of chromatin using magnetic nanoparticles , 2008, Chromosome Research.

[26]  Cees Dekker,et al.  Optical tweezers for force measurements on DNA in nanopores , 2006 .

[27]  Russell M. Taylor,et al.  Thin-foil magnetic force system for high-numerical-aperture microscopy. , 2006, The Review of scientific instruments.

[28]  S. Chu,et al.  Observation of a single-beam gradient force optical trap for dielectric particles. , 1986, Optics letters.

[29]  Fei Long,et al.  Three-Dimensional Visual Servo Control of a Magnetically Propelled Microscopic Bead , 2013, IEEE Transactions on Robotics.

[30]  Karoly Jakab,et al.  Magnetic tweezers for intracellular applications , 2003 .

[31]  Chia-Hsiang Menq,et al.  Best linear unbiased axial localization in three-dimensional fluorescent bead tracking with subnanometer resolution using off-focus images. , 2009, Journal of the Optical Society of America. A, Optics, image science, and vision.

[32]  Chia-Hsiang Menq,et al.  Three-dimensional particle tracking with subnanometer resolution using off-focus images. , 2008, Applied optics.

[33]  Chia-Hsiang Menq,et al.  Real-time in situ calibration of an optically trapped probing system. , 2009, Applied optics.

[34]  Thomas T. Perkins,et al.  Optical traps for single molecule biophysics: a primer , 2009 .