Solid-State Camera System for Fluorescence Lifetime Microscopy

Fluorescence microscopy is a well-established platform for biology and biomedical research (Chapter 2). Based on this platform, fluorescence lifetime imaging microscopy (FLIM) has been developed to measure fluorescence lifetimes, which are independent of fluorophore concentration and excitation intensity and offer more information about the physical and chemical environment of the fluorophore (Chapter 3). The frequency domain FLIM technique offers fast acquisition times required for dynamic processes at the sub-cellular level. A conventional frequency-domain FLIM system employs a CCD camera and an image intensifier, the gain of which is modulated at the same frequency as the light source with a controlled phase shift (time delay). At the moment these systems, based on modulated image intensifiers, have disadvantages such as high cost, low image quality (distortions, low resolution), low quantum efficiency, prone to damage by overexposure, and require high voltage sources and RF amplifiers. These disadvantages complicate the visualization of small sub-cellular organelles that could provide valuable fundamental information concerning several human diseases (Chapter 3 and 4). In order to characterize the constraints involved in current fluorescent microscope systems that are used for lifetime as well as intensity measurements and to design and fabricate new systems, we have constructed a mathematical model to analyze the photon efficiency of frequency-domain fluorescence lifetime imaging microscopy (FLIM) (Chapter 5). The power of the light source needed for illumination in a FLIM system and the signalto-noise ratio (SNR) of the detector have led us to a photon “budget”. A light source of only a few milliWatts is sufficient for a FLIM system using fluorescein as an example. For every 100 photons emitted, around one photon will be converted to a photoelectron, leading to an estimate for the ideal SNR for one fluorescein molecule in an image as 5 (14 dB). We have performed experiments to validate the parameters and assumptions used in the mathematical model. The transmission efficiencies of the lenses, filters, and mirrors in the optical chain can be treated as constant parameters. The Beer-Lambert law is applicable to obtain the absorption factor in the mathematical model. The Poisson distribution assumption used in deducing the SNR is also valid. We have built compact FLIM systems based on new designs of CCD image sensors that can be modulated at the pixel level. Two different designs: the horizontal toggled MEM-FLIM1 camera and vertical toggled MEM-FLIM2 camera are introduced (Chapter 6). By using the camera evaluation techniques described in Chapter 7, these two versions of the MEM-FLIM systems are extensively studied and compared to the conventional image intensifier based FLIM system (Chapter 8). The low vertical charge transport efficiency limited the MEM-FLIM1 camera to perform lifetime experiments, however, the MEM-FLIM2 camera is a success. The MEM-FLIM2 camera not only gives comparable lifetime results with the reference intensifier based camera, but also shows a much better image quality and reveals more detailed structures in the biological samples. The novel MEM-FLIM systems are able to shorten the acquisition time since they allows recording of two phase images at once. The MEM-FLIM2 camera is, however, not perfect. It can only be modulated at a single frequency (25 MHz) and requires that the light source be switched off during readout due to an aluminum mask that had a smaller area than intended. A redesign of the architecture based on the vertical toggling concept leads to the MEM-FLIM3 camera (Chapter 9). Several improvements have been made in the sensor design for the MEMFLIM3 camera, such as higher fill factor, greater number of pixels etc. The MEM-FLIM3 camera is able to operate at higher frequencies (40, 60 and 80 MHz) and has an option for electron multiplication. Evaluations of this updated MEM-FLIM system are presented (Chapter 10). The images obtained from the MEM-FLIM3 camera at 20 and 40 MHz can be used directly for the lifetime calculation and the obtained lifetimes are comparable with the ones from the reference camera. There are, however, differences in the even and odd columns (20 MHz) and four image sections (40 MHz) for the intensity and lifetime images. For higher frequencies (60 and 80 MHz) calibrations are needed before calculating lifetimes. The lifetimes derived from the modulation depth after the calibrations are in a reasonable range while the lifetime derived from the phase cannot be used. At 60 and 80 MHz we can use one phase register from the MEM-FLIM3 camera for the lifetime calculation, the same way the reference camera operates. The lifetimes obtained by this method from the MEM-FLIM3 at 60 and 80 MHz are comparable with the ones from the reference camera. The MEM-FLIM3 camera also has an electron multiplication feature for low-light experimental condition. We could get approximately 500 times multiplication. Lifetime measurement using the EM function, however, has not been tested due to the limitation of the project time.

[1]  Michael Spencer,et al.  Fundamentals of light microscopy , 1982 .

[2]  György Vereb,et al.  Selecting the right fluorophores and flow cytometer for fluorescence resonance energy transfer measurements , 2005, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[4]  T. Terwilliger,et al.  Engineering and characterization of a superfolder green fluorescent protein , 2006, Nature Biotechnology.

[5]  Ryuichi Shimizu,et al.  Real-time lock-in imaging by a newly developed high-speed image-processing charge coupled device video camera , 2003 .

[6]  A. Fletcher,et al.  Fluorescence quantum yields of some rhodamine dyes , 1982 .

[7]  Dietrich Marcuse Engineering quantum electrodynamics , 1970 .

[8]  W. J. Bates The Theory of the Microscope , 1968 .

[9]  H. Gerritsen,et al.  Fluorescence lifetime imaging in scanning microscopes: acquisition speed, photon economy and lifetime resolution , 2002, Journal of microscopy.

[10]  Harry van Kuijk,et al.  MEM-FLIM: all-solid-state camera for fluorescence lifetime imaging , 2012, Other Conferences.

[11]  Sjoerd Stallinga,et al.  mb-FLIM: model-based fluorescence lifetime imaging , 2012, Other Conferences.

[12]  C G Morgan,et al.  Measurement of nanosecond time‐resolved fluorescence with a directly gated interline CCD camera , 2002, Journal of microscopy.

[13]  Y. Usson,et al.  Quantitative comparison of polar approach versus fitting method in time domain FLIM image analysis , 2011, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[14]  Robert M. Clegg,et al.  Fluorescence lifetime imaging microscopy (FLIM): Spatial resolution of microstructures on the nanosecond time scale , 1993 .

[15]  Steffen Lindek,et al.  Confocal theta microscopy and 4Pi-confocal theta microscopy , 1994, Electronic Imaging.

[16]  F. Zernike Phase contrast, a new method for the microscopic observation of transparent objects , 1942 .

[17]  P J Verveer,et al.  Global analysis of fluorescence lifetime imaging microscopy data. , 2000, Biophysical journal.

[18]  T. Kues,et al.  Imaging and tracking of single GFP molecules in solution. , 2000, Biophysical journal.

[19]  Clemens F Kaminski,et al.  Theoretical investigation of the photon efficiency in frequency-domain fluorescence lifetime imaging microscopy. , 2008, Journal of the Optical Society of America. A, Optics, image science, and vision.

[20]  Hans C Gerritsen,et al.  Innovating lifetime microscopy: a compact and simple tool for life sciences, screening, and diagnostics. , 2006, Journal of biomedical optics.

[21]  Squire,et al.  Multiple frequency fluorescence lifetime imaging microscopy , 2000, Journal of microscopy.

[22]  Klaus Suhling,et al.  Time-resolved fluorescence microscopy , 2007, SPIE Optics East.

[23]  I. Young,et al.  Photon budget analysis for a novel fluorescence lifetime imaging microscopy system with a modulated electron-multiplied all-solid-state camera , 2009, 2009 IEEE 3rd International Conference on Nano/Molecular Medicine and Engineering.

[24]  U. Schreiber,et al.  Light-induced dynamic changes of NADPH fluorescence in Synechocystis PCC 6803 and its ndhB-defective mutant M55. , 2000, Plant & cell physiology.

[25]  Douglas Magde,et al.  Fluorescence Quantum Yields and Their Relation to Lifetimes of Rhodamine 6G and Fluorescein in Nine Solvents: Improved Absolute Standards for Quantum Yields¶ , 2002, Photochemistry and photobiology.

[26]  J. D. Meindl,et al.  One-phase CCD: a new approach to charge-coupled device clocking , 1972 .

[27]  F. Wouters,et al.  Optimizing frequency-domain fluorescence lifetime sensing for high-throughput applications: photon economy and acquisition speed. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[28]  T Wilson,et al.  Low‐cost, frequency‐domain, fluorescence lifetime confocal microscopy , 2004, Journal of microscopy.

[29]  Picosecond fluorescence lifetime imaging by parametric image amplification , 2005 .

[30]  I. Pelant,et al.  Data processing correction of the irising effect of a fast-gating intensified charge-coupled device on laser-pulse-excited luminescence spectra. , 2010, The Review of scientific instruments.

[31]  Nobuhiro Ohta,et al.  Application of fluorescence lifetime imaging of enhanced green fluorescent protein to intracellular pH measurements , 2008, Photochemical & photobiological sciences : Official journal of the European Photochemistry Association and the European Society for Photobiology.

[32]  René Doyon,et al.  Electron-multiplying CCDs for future space instruments , 2013, Other Conferences.

[33]  I T Young,et al.  Image fidelity: characterizing the imaging transfer function. , 1989, Methods in cell biology.

[34]  I. Young,et al.  Photon budget analysis for fluorescence lifetime imaging microscopy. , 2011, Journal of biomedical optics.

[35]  Sytsma,et al.  Time‐gated fluorescence lifetime imaging and microvolume spectroscopy using two‐photon excitation , 1998 .

[36]  J. Janesick,et al.  Scientific Charge-Coupled Devices , 2001 .

[37]  Rafael Yuste,et al.  Two-Photon Microscopy with Diffractive Optical Elements and Spatial Light Modulators , 2010, Front. Neurosci..

[38]  J. Jensen,et al.  Photonic crystal fiber based evanescent-wave sensor for detection of biomolecules in aqueous solutions , 2003, Conference on Lasers and Electro-Optics, 2003. CLEO '03..

[39]  David Tyndall,et al.  Time-Domain Fluorescence Lifetime Imaging Techniques Suitable for Solid-State Imaging Sensor Arrays , 2012, Sensors.

[40]  G. J. Brakenhoff,et al.  Confocal scanning light microscopy with high aperture immersion lenses , 1979 .

[41]  S. Hell,et al.  Properties of a 4Pi confocal fluorescence microscope , 1992 .

[42]  P. L. Becker,et al.  Photobleaching of fura-2 and its effect on determination of calcium concentrations. , 1987, The American journal of physiology.

[43]  J. Ploem,et al.  The use of a vertical illuminator with interchangeable dichroic mirrors for fluorescence microscopy with incidental light. , 1967, Zeitschrift fur wissenschaftliche Mikroskopie und mikroskopische Technik.

[44]  Axel Bergmann,et al.  High resolution TCSPC lifetime imaging , 2003, SPIE BiOS.

[45]  Y. Urano,et al.  Development of a highly specific rhodamine-based fluorescence probe for hypochlorous acid and its application to real-time imaging of phagocytosis. , 2007, Journal of the American Chemical Society.

[46]  P. Magnan Detection of visible photons in CCD and CMOS: A comparative view , 2003 .

[47]  C G Morgan,et al.  Direct modulation of the effective sensitivity of a CCD detector: a new approach to time‐resolved fluorescence imaging , 2002, Journal of microscopy.

[48]  Joachim Goedhart,et al.  A mTurquoise-Based cAMP Sensor for Both FLIM and Ratiometric Read-Out Has Improved Dynamic Range , 2011, PloS one.

[49]  Wilco Klaassens,et al.  MEM-FLIM , a CCD imager for Fluorescence Lifetime Imaging Microscopy , 2013 .

[50]  Michael Wahl,et al.  Time-Correlated Single Photon Counting , 2009 .

[51]  D. Axelrod Cell-substrate contacts illuminated by total internal reflection fluorescence , 1981, The Journal of cell biology.

[52]  Edoardo Charbon,et al.  Video-rate fluorescence lifetime imaging camera with CMOS single-photon avalanche diode arrays and high-speed imaging algorithm. , 2011, Journal of biomedical optics.

[53]  Peter J. Verveer,et al.  Frequency Domain FLIM Theory, Instrumentation and Data Analysis , 2009 .

[54]  Armin Karcher,et al.  Fully depleted back-illuminated p-channel CCD development , 2004, SPIE Optics + Photonics.

[55]  P. Jain,et al.  Calculated absorption and scattering properties of gold nanoparticles of different size, shape, and composition: applications in biological imaging and biomedicine. , 2006, The journal of physical chemistry. B.

[56]  Joaquim Salvi,et al.  Review of CMOS image sensors , 2006, Microelectron. J..

[57]  Erick R. Malaret,et al.  A radiometric calibration for the Clementine HIRES camera , 2003 .

[58]  A. Theuwissen,et al.  Solid-State Imaging with Charge-Coupled Devices , 1995 .

[59]  Harry van Kuijk,et al.  Modulated electron-multiplied fluorescence lifetime imaging microscope: all-solid-state camera for fluorescence lifetime imaging , 2012, Journal of biomedical optics.

[60]  C Cremer,et al.  Considerations on a laser-scanning-microscope with high resolution and depth of field. , 1978, Microscopica acta.

[61]  Emil Wolf,et al.  Principles of Optics: Contents , 1999 .

[62]  Fu-Jen Kao,et al.  Fluorescence lifetime dynamics of enhanced green fluorescent protein in protein aggregates with expanded polyglutamine. , 2010, Journal of biomedical optics.

[63]  I T Young,et al.  Calibration: Sampling Density and Spatial Resolution , 1998, Current protocols in cytometry.

[64]  F. Wouters,et al.  All-solid-state lock-in imaging for wide-field fluorescence lifetime sensing. , 2005, Optics express.

[65]  A. Visser,et al.  Construction and characterization of a frequency-domain fluorescence lifetime imaging microscopy system , 1997, Journal of Fluorescence.

[66]  I. T. Young,et al.  Photobleaching kinetics of fluorescein in quantitative fluorescence microscopy. , 1995, Biophysical journal.

[67]  Borivoj Vojnovic,et al.  A dark yellow fluorescent protein (YFP)-based Resonance Energy-Accepting Chromoprotein (REACh) for Förster resonance energy transfer with GFP. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[68]  Michel Willemin,et al.  Optical characterization methods for solid-state image sensors , 2001 .

[69]  B. Spring,et al.  Image analysis for denoising full‐field frequency‐domain fluorescence lifetime images , 2009, Journal of microscopy.

[70]  W. Becker Fluorescence lifetime imaging – techniques and applications , 2012, Journal of microscopy.

[71]  Markus Fischer,et al.  A brilliant monomeric red fluorescent protein to visualize cytoskeleton dynamics in Dictyostelium , 2004, FEBS letters.

[72]  C. Kaminski,et al.  Calibration of a wide‐field frequency‐domain fluorescence lifetime microscopy system using light emitting diodes as light sources , 2006, Journal of microscopy.

[73]  R. Tsien,et al.  A new generation of Ca2+ indicators with greatly improved fluorescence properties. , 1985, The Journal of biological chemistry.

[74]  James R. Janesick Lux transfer: Complementary metal oxide semiconductors versus charge-coupled devices , 2002 .

[75]  A. Fontes,et al.  Semiconductor fluorescent quantum dots: efficient biolabels in cancer diagnostics. , 2009, Methods in molecular biology.

[76]  S. Karamanou,et al.  Quantitative analysis of energy transfer between fluorescent proteins in CFP-GBP-YFP and its response to Ca2+. , 2011, Physical Chemistry, Chemical Physics - PCCP.

[77]  Ian T. Young,et al.  Fundamentals of Image Processing , 1998 .

[78]  K. Carlsson,et al.  Theoretical investigation of the signal-to-noise ratio in fluorescence lifetime imaging. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[79]  J. Goodman Introduction to Fourier optics , 1969 .

[80]  Takeo Kanade,et al.  CCD-based range-finding sensor , 1997 .

[81]  J Padawer,et al.  The Nomarski interference-contrast microscope. An experimental basis for image interpretation. , 1968, Journal. Royal Microscopical Society.

[82]  Brian Herman,et al.  Fluorescence Lifetime Imaging Microscopy , 2000 .