Open Access
Add to BibSonomyAbstract
We present a handheld dual-axes confocal microscope that is based on a two-dimensional microelectromechanical systems (MEMS) scanner. It performs reflectance and fluorescence imaging at 488 nm wavelength, with three-dimensional imaging capability. The fully packaged microscope has a diameter of 10 mm and acquires images at 4 Hz frame rate with a maximum field of view of 400 µm×260 µm. The transverse and axial resolutions of the handheld probe are 1.7 µm and 5.8 µm, respectively. Capability to perform real time small animal imaging is demonstrated in vivo in transgenic mice.
©2008 Optical Society of America
1. Introduction
There is an urgent need for in vivo imaging at cellular and subcellular resolution both for clinical applications and for small animal research. Medical diagnoses are typically based on histopathology after removal of tissues, which negates the possibility of real time information and limits the amount of tissue that can be analyzed. Small animal models are increasingly recognized as powerful discovery tools for mammalian biology, elucidating disease mechanisms and advancing therapies, especially with recent innovations in molecular probe designs and fluorescent markers. Interrogating biological changes at cellular resolution has typically required tissue acquisition via biopsy, or at the time of necropsy or autopsy. This constrains researchers to examining tissues out of context, or postmortem samples preventing longitudinal studies. The ability to examine in vivo pathologic conditions over time within living tissue, will refine diagnostic tools and stimulate the emerging field of in vivo pathology, enabling the full potential of small animal (intravital) imaging to be realized.
Confocal microscopy is a powerful imaging technique for this task, due to its capability to perform high resolution imaging and optical sectioning in both reflectance and fluorescence modes [1]. Reflectance imaging yields information on cell and tissue microanatomy. Fluorescence imaging enables the study of cell function through the use of targeted fluorescent probes and intravital dyes. Despite these advantages, in vivo application of confocal microscopy has been constrained by bulk optics. Significant effort has thus been put into miniaturization. Microelectromechanical systems (MEMS) devices offer innovative solutions to miniaturization [2–6]. However, conventional single-axis confocal microscopes have a tradeoff between resolution, size, and working distance (WD). The need for high resolution requires a larger high numerical aperture (NA) objective, resulting in a shorter WD. This presents a challenge in miniaturization, especially for applications requiring in vivo imaging at deep depths within tissue.
The dual-axes confocal architecture has been developed to overcome these limitations [7]. The design uses two low NA beams (illumination and collection) with overlapping focal volumes, amenable for miniaturization. This configuration offers several advantages. First, subcellular resolution is achieved in both transverse and axial dimensions. This is because the axial resolution decreases linearly with 1/NA, as opposed to 1/NA2 for the single-axis architecture. Second, the long WD provided by low NA lenses allows post-objective scanning, enabling larger field of view (FOV). Third, improved rejection of multiply-scattered photons in the collection beam enhances detection sensitivity and dynamic range compared to the single-axis architecture. This has been shown in Monte Carlo simulations [8].
Integration of a two-dimensional (2-D) MEMS scanner with the dual-axes confocal architecture enables the microscope system to be containable in a miniature package while enhancing imaging performance. We have previously reported on the design and fabrication of the MEMS scanner, and its integration with a dual-axes imaging system in a breadboard setup [9]. The first prototypes of the miniaturized package was demonstrated with en face reflectance imaging at 1315 nm wavelength [10], and fluorescence imaging at 785 nm wavelength [11, 12], both of which focus on clinical applications. In this paper, we present a fully packaged handheld dual-axes confocal microscope capable of three-dimensional (3-D) reflectance and fluorescence imaging at 488 nm wavelength [13] for intravital imaging. We demonstrate real-time, volumetric imaging of transgenic mice both ex vivo and in vivo.
2. Methods
2.1 Optical system
A diagram of the imaging system is shown in Fig. 1. An optically pumped semiconductor laser at 488 nm wavelength is used as the light source. The laser light is coupled into a single mode fiber (SMF, Fibercore Limited, SM450) which collimates the beam using a graded index (GRIN) collimator (GRINTECH GmbH) at the distal end. The collimated beam is focused by a parabolic mirror, reflects off the MEMS scanner, and continues through a hemispherical lens (HL) into the sample. Signal from overlapping focal volumes within the sample propagates through the other optical branch. The collected photon signal is amplified by a photomultiplier tube (PMT). As the MEMS mirror raster scans the sample, signal from each pixel is collected and displayed on the computer screen as an en face image using a frame grabber and image acquisition software. 3-D volume data is obtained by translating the MEMS scanner in the z (depth)-direction using a computer-controlled piezoelectric actuator (Physik Instrumente, P-783), which varies the WD. The stack of 2-D en face images can later be compiled into a 3-D image. Imaging can be performed in reflectance mode or in fluorescence mode by inserting a long-pass optical filter (λ>494 nm) in the collection path for the latter case.
A schematic diagram of the 10 mm diameter imaging head is shown in Fig. 2(a) with a photograph of the MEMS scanner mounted on a printed circuit board (PCB) in the inset. Fig. 2(b) shows the fully assembled handheld probe mounted in an upright position. The probe assembly starts with mounting two fiber-pigtailed GRIN collimators in the two precision machined v-grooves within the housing. The fibers are designed for single-mode operation at 488 nm wavelength. Then a pair of Risley prisms is mounted in each v-groove in front of the collimators to adjust for the illumination and collection beams to be parallel. This will ensure that the foci of the two beams will coincide after being focused by the parabolic mirror. The MEMS scanner is separately mounted on a PCB, and wirebonded to the PCB bondpads that are connected to wires running through the middle of the housing. The backplane that holds the PCB is connected to a z-translation stage that is actuated by the closed-loop piezoelectric actuator. Finally, the image head is sealed with UV-curing glue to prevent leakage when imaging live specimen.
Fig. 2. (a) Schematic of the 10 mm diameter handheld probe with the packaged MEMS scanner in the inset. (b) Photograph of the fully assembled dual-axes confocal handheld probe.
2.2 MEMS scanner
An SEM image of the MEMS scanner is shown in Fig. 3. The overall chip size of the scanner is 3.2 mm×2.9 mm. The scanner is metallized with a 12-nm-thick layer of aluminum to increase reflectivity for higher photon efficiency. This is important for fluorescence imaging to compensate for our lower collection NA of 0.11. Aluminum metallization increases our reflectivity by a factor of two from 37% to 74% compared to bare single crystalline silicon. Since the imaging beam reflects off the MEMS scanner twice before collection, the effective increase in photon efficiency is a factor of four. The radius of curvature for the metallized mirror is 95.4 cm, and the average surface roughness is 6 nm.
The resonance frequency of the scanner is 760 Hz and 2.43 kHz for the outer and inner axes, respectively. For 2-D en face imaging, rotation around the outer axis (V1 and V2) is resonantly driven at 760 Hz with a sine wave at maximum 45V, while rotation around the inner axis (V3 and V4) is driven at 4 Hz with a sawtooth waveform at maximum 75V, in order to maximize FOV. The sawtooth waveform is smoothed at the transition edges to mitigate higher frequency ringing on the inner axis. The opposite-side drive waveforms (V1 and V2 for the outer axis, and V3 and V4 for the inner axis) are 180° out of phase to maximize the linear region of motion.
2.3 Control and acquisition system
The imaging system is controlled using LabVIEW™ software and three National Instruments™ boards (two of PCI-6711, one of PCI-6115). The frequency and amplitude of four actuation signals control the frame rate and FOV of the MEMS scanner. The step size and depth range of the piezoelectric actuator can be adjusted to optimize acquisition of 3-D datasets. The PMT gain can also be synchronously adjusted to compensate for decreasing signal levels at increasing depths. Automated frame averaging and display can be performed to reduce noise and improve image quality during imaging. 2-D en face images from the analog input channel signal are acquired and displayed in real time to enable continuous monitoring of the image sample. All images are saved in 12-bit format. 3-D volume data can be rendered by post-processing using Amira® software.
3. Results
3.1 Probe Characterization
The probe is characterized in the reflectance mode by imaging a highly reflective US Air Force (USAF) target. The transverse resolution of the probe is acquired by the knife-edge method [15]. The measured full-width-half-maximum (FWHM) resolutions of the inner and outer scan axes are 1.7 µm and 3.2 µm, respectively. Figure 4 shows group 7 of the USAF target, where the last element, having a linewidth of 2.2 µm, is clearly resolved. The image plane is slightly curved due to the MEMS mirror scanning over an arched plane. The axial resolution is measured by actuating the piezoelectric actuator with a sawtooth waveform and translating the focus through a reflective mirror. The FWHM axial resolution is measured to be 5.8 µm. The measured values are slightly larger than the theoretical resolutions of 1.6 µm and 1.8 µm for the transverse dimensions, and 4.0 µm for the axial dimension [7]. This is mainly due to the decrease in effective NA from the clipping of the collimated beam by the outer-axis dimension of the MEMS scanner chip. In addition, alignment errors occurred from the shifting of Risley prisms while fixing with UV-curing glue.
3.2 Fluorescence Imaging
3.2.1 Ex vivo imaging
Tissue imaging was performed with the handheld dual-axes confocal probe. We first imaged excised tissue obtained from transgenic mice expressing green fluorescent protein (GFP; B5/EGFP “Nagy” mouse, Jackson Laboratory). This transgenic strain expresses enhanced GFP (EGFP) throughout many tissues, although the level of expression varies between different organs [14]. Handheld probe images were taken at 4 frames per second over a maximum FOV of 400 µm×260 µm and displayed in 400×190 pixels. Figure 5(a) and (c) show en face images of freshly excised tissue of a GFP mouse. Figure 5(a) shows an acquired image of adipocytes (fat cells) from the hind leg region. After imaging, the tissue was fixed in 10% buffered formalin, cut into 5 µm sections, and processed with routine hematoxylin and eosin (H&E) staining. This procedure is widely used for tissue morphologic interpretation and medical diagnosis. A representative histologic image from the same tissue block taken using a commercial wide-field microscope is shown in Fig. 5(b), where similar adipocytes are observed. Figure 5(c) displays the dual-axes confocal image of the villi structure in the small intestine, corresponding to histology in Fig. 5 (d). Two villi are clearly visible, illustrating the highly fluorescent enterocyte layer forming the boundary of the villi and surrounding the core lamina propria. Each image is an average of 4 frames. There is a good correspondence in structure and size between the acquired image and histology from the same tissue.
Fig. 5. Ex vivo images of freshly excised GFP mouse tissue and corresponding histology. (a) Adipocytes in the hind leg region. (b) Histology of adipocytes. (c) Villi in the small intestine. (d) Histology of small intestine.
The 3-D imaging capability of the miniaturized probe is demonstrated in Fig. 6. Figure 6(a) shows three en face planes extracted from a 3-D volume rendering of the upper hind leg of a GFP mouse. The images are acquired at 35 µm, 65 µm, and 100 µm below the surface. For each z-section slice, distinct muscle structure is clearly resolved. The gain is increased with depth to compensate for lower signal levels. The movie file shows the entire image stack acquired from the surface to 130 µm depth. Figure 6(b) shows one frame from the stack at 65 µm depth. The striation patterns of skeletal muscle can be observed. Figure 6(c) shows images from a 3-D tissue volume of the front brain. The three planes are at depths of 12 µm, 40 µm, and 72 µm below the surface. The movie file shows the entire image stack acquired from the surface to 80 µm depth. Vessel-like structures are clearly visible connected throughout the volume. Each frame is an average of 4 frames. Color mapping is used in post-processing to better display the 12-bit data. No other image processing is applied. A maximum intensity projection image obtained from the 3-D rendering is shown in Fig. 6(d), showing the network of connected structures throughout the volume. The ability to compile a high resolution 3-D volume from 2-D en face image stacks demonstrates the power of optical sectioning from the handheld probe.
Fig. 6. Ex vivo images of freshly excised GFP mouse tissue. Three en face planes extracted from a 3-D volume rendering and movies of the entire image stack are shown in (a) and (c). (a) Muscle. (Movie size 2.9 MB) (b) One en face image within the stack. (c) Vessel-like structures in the brain. (Movie size 2.7 MB) (d) Maximum intensity projected image of the stack. [Media 1][Media 2]
3.2.2 In vivo imaging
In vivo imaging was performed on a mouse anesthetized with Avertin (250 µL). Fluorescein isothiocyanate–dextran (FITC-dextran, 2,000,000 average molecular weight, 100µL) was injected into the retro-orbital plexus prior to imaging. Imaging was performed by resting the mouse on a stage and placing its intact ear on the hemispherical lens window of the inverted microscope. Figure 7(a) shows a 3-D volume rendering of the image stack obtained by scanning from the surface to 90 µm deep into the tissue. The images were taken in 2 µm intervals in depth with the piezoelectric actuator. All frames were taken at 4 frames per second with averaging of 4 frames. The full 3-D volume was acquired in 45 seconds. The maximum intensity projected image of the stack is shown in Fig. 7(b). The vessels containing the FITC-dextran solution can be clearly delineated in the image. Since FITC-dextran slowly leaks out of the vessels over time, faint fluorescence signals outside the vessels can also be observed.
Fig. 7. In vivo image of blood vessels in an intact mouse ear. (a) 3-D volume rendering. (b) Maximum intensity projected image of the stack.
4. Discussion
The reported handheld dual-axes confocal microscope was developed primarily for small animal (intravital) imaging. We have tested our microscope system by collecting real-time images and 3-D data from transgenic mice, to assess imaging performance under intravital imaging conditions. One of our current limitations is the relatively low sample illumination power of 1.3 mW. This is due to the free-space coupling loss from the 488 nm laser into the input SMF, and insertion loss of the optical components along the beam path. This can be improved by having a higher power fiber-coupled laser source and increasing the metallization layer thickness of the MEMS scanner for higher reflectivity. Another challenge is alignment of the microscope assembly. Accurately aligning the collimated illumination and collection beams ensures that the two foci overlap. Although the Risley prism pairs are used for fine tuning the alignment of this process, the last curing step of UV adhesive shifts the components and creates misalignment. Use of smaller angle Risley prisms and low shrinkage UV curing adhesive will secure proper alignment.
In our in vivo experiments, fluorescence signal was acquired down to 150 µm depth at 488 nm wavelength. This demonstrates the large dynamic range from the dual-axes confocal architecture enabling deep subsurface imaging in tissue, in accordance with previous optical simulation results [8]. Images are acquired at 12 bits per pixel to accommodate the large dynamic range.
Figure 5(a) and (c) are 8-bit grayscale images as they are displayed on the computer screen during real-time image acquisition. In Figures 6 and 7, the stored raw data is presented in a colormap which displays the full range of signal intensity for every pixel. Signal levels usually fall within the 11-bit range. Color mapping gives better visual information of acquired images. Therefore, it will be valuable to integrate this display option in the real-time acquisition program.
The main goal of the handheld dual-axes confocal microscope is to perform high resolution 3-D in vivo intravital imaging in flexible positions and configurations. The microscope can be used for screening in handheld mode, then fixed in position at various angles and orientations for stable 3-D imaging.
5. Conclusion
We have demonstrated a handheld dual-axes confocal microscope operating at 488 nm wavelength for intravital imaging. The microscope is fully packaged and sealed, encasing a MEMS scanner that performs real-time 2-D en face imaging. Intravital imaging results show that the microscope can perform 3-D reflectance and fluorescence imaging in vivo. This will enable the acquisition of morphological and functional data in live animal models. All system components can be mounted on a portable unit to enable imaging in a variety of research settings.
Acknowledgements
The authors would like to thank Larry K. Wong, Jonathan T. C. Liu, and Robert P. J. Barretto for their technical assistance. This work was supported by the National Institutes of Health (grants U54 CA105296 and R33 CA109988). Pei-Lin Hsiung is supported by the Canary Foundation/American Cancer Society Early Detection Postdoctoral Fellowship.
References and links
1. J. Pawley, ed., Handbook of Biological Confocal Microscopy, 3rd ed. (Plenum, New York, 1996).
2. D. L. Dickensheets and G. S. Kino, “Silicon-micromachined scanning confocal microscope,” J. Microelectromech. Syst. 7, 38–47 (1998). [CrossRef]
3. W. Piyawattanametha, H. Toshiyoshi, J. LaCosse, and M. C. Wu, “Surface-micromachined confocal scanning optical microscope,” in Conference on Lasers and Electro-Optics, Technical Digest (Optical Society of America, 2000), pp. 447–448.
4. K. Murakami, A. Murata, T. Suga, H. Kitagawa, Y. Kamiya, M. Kubo, K. Matsumoto, H. Miyajima, and M. Katashiro, “A miniature confocal optical microscope with MEMS gimbal scanner,” in Technical Digest of Transducers (Boston, 2003), pp. 587–590.
5. S. Kwon and L. P. Lee, “Micromachined transmissive scanning confocal microscope,” Opt. Lett. 29, 706–708 (2004). [CrossRef] [PubMed]
6. H.-J. Shin, M. C. Pierce, D. Lee, H. Ra, O. Solgaard, and R. Richards-Kortum, “Fiber-optic confocal microscope using a MEMS scanner and miniature objective lens,” Opt. Express 15, 9113–9122 (2007). http://www.opticsinfobase.org/abstract.cfm?URI=oe-15-15-9113 [CrossRef] [PubMed]
7. T. D. Wang, M. J. Mandella, C. H. Contag, and G. S. Kino, “Dual-axis confocal microscope for high-resolution in vivo imaging,” Opt. Lett. , 28, 414–416 (2003). [CrossRef] [PubMed]
8. L. K. Wong, M. J. Mandella, G. S. Kino, and T. D. Wang, “Improved rejection of multiply scattered photons in confocal microscopy using dual-axes architecture,” Opt. Lett. 32, 1674–1676 (2007). [CrossRef] [PubMed]
9. H. Ra, W. Piyawattanametha, Y. Taguchi, D. Lee, M. J. Mandella, and O. Solgaard, “Two-Dimensional MEMS Scanner for Dual-Axes Confocal Microscopy,” J. Microelectromech. Syst. 16, 969–976 (2007). [CrossRef]
10. W. Piyawattanametha, J. T. C. Liu, M. J. Mandella, H. Ra, L. K. Wong, P. Hsiung, T. D. Wang, G. S. Kino, and O. Solgaard, “MEMS Based Dual-axes Confocal Reflectance Handheld Microscope for in vivo Imaging,” in Proceedings of IEEE International Conference on Optical MicroElectroMechanical Systems, (Institute of Electrical and Electronics Engineers, Montana, August, 2006), pp.164–165.
11. J. T.C. Liu, M. J. Mandella, H. Ra, L. K. Wong, O. Solgaard, G. S. Kino, W. Piyawattanametha, C. H. Contag, and T. D. Wang, “Miniature near-infrared dual-axes confocal microscope utilizing a twodimensional microelectromechanical systems scanner,” Opt. Lett. 32, 256–258 (2007). [CrossRef] [PubMed]
12. W. Piyawattanametha, H. Ra, M. J. Mandella, J. T. C. Liu, L. K. Wong, C. B. Du, T. D. Wang, C. H. Contag, G. S. Kino, and O. Solgaard, “Three-dimensional in vivo Real Time Imaging by a Miniature Dual-axes Confocal Microscope based on a Two-dimensional MEMS Scanner,” in Proceedings of International Conference on Solid-State Sensors, Actuators, and Microsystems, (Lyon, France, June, 2007), pp. 439–442.
13. H. Ra, W. Piyawattanametha, M. J. Mandella, J. T. C. Liu, L. K. Wong, T. D. Wang, C. H. Contag, G. S. Kino, and O. Solgaard, “Three-Dimensional in vivo Reflectance and Fluorescence Imaging by a Handheld Dual-Axes Confocal Microscope,” in Conference on Lasers and Electro-Optics/Quantum Electronics and Laser Science and Photonic Applications Systems Technologies, Technical Digest (CD) (Optical Society of America, May, 2007), paper CTuEE1. http://www.opticsinfobase.org/abstract.cfm?URI=CLEO-2007-CTuEE1
14. A.-K. Hadjantonakis, M. Gertsenstein, M. Ikawa, M. Okabe, and A. Nagy, “Generating green fluorescent mice by germline transmission of green fluorescent ES cells,” Mech. Dev. 76, 79–90 (1998). [CrossRef] [PubMed]
15. A. E. Siegman, M. W. Sasnett, and T. F. Johnston, Jr., “Choice of clip levels for beam width measurements using knife-edge techniques,” IEEE J. Quantum Electron. 27, 1098–1104 (1991). [CrossRef]
