Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Improved quantitative phase imaging in lensless microscopy by single-shot multi-wavelength illumination using a fast convergence algorithm

Open Access Open Access

Abstract

We report on a novel algorithm for high-resolution quantitative phase imaging in a new concept of lensless holographic microscope based on single-shot multi-wavelength illumination. This new microscope layout, reported by Noom et al. along the past year and named by us as MISHELF (initials incoming from Multi-Illumination Single-Holographic-Exposure Lensless Fresnel) microscopy, rises from the simultaneous illumination and recording of multiple diffraction patterns in the Fresnel domain. In combination with a novel and fast iterative phase retrieval algorithm, MISHELF microscopy is capable of high-resolution (micron range) phase-retrieved (twin image elimination) biological imaging of dynamic events. In this contribution, MISHELF microscopy is demonstrated through qualitative concept description, algorithm implementation, and experimental validation using both a synthetic object (resolution test target) and a biological sample (swine sperm sample) for the case of three (RGB) illumination wavelengths. The proposed method becomes in an alternative instrument improving the capabilities of existing lensless microscopes.

© 2015 Optical Society of America

1. Introduction

Lensless holographic microscopy (LHM) in the digital domain has nowadays becoming in a valuable and versatile tool for different applications ranging from biology [1–3], point-of-care testing [4], telemedicine [5] and optofluidic [6] applications, just to cite a few. LHM supposes a digital version of the Gabor’s concept implemented for electron microscopy in the middle of the XX century [7] and later adapted to the optical range by Rogers [8]. Classical LHM working scheme uses a point source (typically in the form of a spatial aperture or pinhole [1,3,5,6]) of coherent (laser) light. But successful implementations have been validated using alternative illumination variations such as LEDs [9], super luminescent diodes [10] or pulsed laser radiation [11], and point sources using GRIN lenses [12] or fiber optics [13].

Aside of other restrictions (mainly, coherent noise and weak diffraction assumption [13]), Gabor’s concept of holography is affected by the twin image problem as a direct consequence of the in-line configuration [14]. Essentially, a misfocused version of the twin image disturbs final image quality when imaging at the real image term. Twin image can be eliminated in Gabor-like layouts by using typically two different strategies: phase-shifting [15–18] and phase retrieval [19–28] procedures. Phase shifting is based on the relative phase variation between both interferometric beams and phase retrieval can be conducted from iterative [19–23] as well as from deterministic [24–28] algorithms. In any case [19–28], several holograms incoming from mechanical displacement of the camera [19,20] or by tuning the illumination wavelength [21,22] or by defocusing the image using a SLM [23] or by solving deterministic equations of the propagation field [24–28] must be recorded.

Among them, in [28] Waller et al. refer to a clever method to retrieve phase distribution based on the transport of intensity equation (TIE) where the axial defocus needed between images is provided by the intrinsic chromatic aberration of imaging lenses. Using broadband illumination and conventional RGB color camera, the approach provides 3 axially slightly defocused images (one in focus, one under and other over focus) corresponding with the 3 color camera channels. These 3 intensity images are the TIE algorithm inputs. Moreover, the retrieved quantitative phase information is obtained in a single camera snap-shot meaning that it is the camera acquisition rate the limiting factor for imaging dynamic biological processes. Note that phase-shifting [15–18] as well as phase retrieval [24–27] imply the recording in time sequence of multiple (more than two) in-line images before applying the phase recovery cycle, thus preventing (at least in a factor of two) the analysis of fast dynamic events.

As a continuation of its previous work [29], Noom et al. have recently presented a quantitative phase contrast LHM method first under sequential illumination/recording mode [30] and after with high-speed capabilities [31]. Their approach is based on a similar concept than in [28] but applied in the domain of LHM: while the concept presented by Waller et al. [28] is based on a refractive principle (axial chromatic aberration), the principle proposed by Noom et al. [31] is based on the wavelength dependence of diffraction. On both cases, 3 simultaneous sample images (slightly defocused intensity images and Fresnel domain in-line holograms for the Waller et al. and Noon et al. cases, respectively) are recorded in a single snap-shot of a color camera. Noon et al. method [31] records 3 Fresnel diffraction patterns generated at the digital sensor plane by illuminating the sample with 3 simultaneous RGB wavelengths incoming from a fiber coupled source containing 3 diode lasers (636 nm, 519 nm, and 402 nm). After that, digital image processing based on numerical propagation and phase retrieval algorithm performs final phase contrast image of the inspected sample.

In this manuscript, we report on a similar hardware concept of LHM but having improved capabilities concerning quantitative phase imaging, resolution and processing time. As in the Noom et al. method [31], a trichromatic illumination source is used to record 3 simultaneous in-line holograms in a single CCD recording. Then, the holograms are digitally processed using a novel algorithm yielding in high-resolution noise-reduced quantitative phase imaging due to coherent noise averaging and twin image elimination. Moreover, the proposed algorithm provides a fast convergence to the final result in comparison with the one reported by Noom et al. [31]. We have named this new microscope layout as MISHELF, initials incoming from Multi-Illumination Single-Holographic-Exposure Lensless Fresnel.

The manuscript is organized as follows. Section 2 presents the experimental layout as well as a detailed description of the phase retrieval algorithm. Section 3 includes experimental validation concerning a synthetic object (resolution test target) and a biological sample (swine sperm cells). And Section 4 discusses and concludes the paper.

2. Experimental layout and digital image processing in MISHELF microscopy

2.1 Experimental layout

The proposed experimental setup is outlined at Fig. 1. Three laser illumination wavelengths at 405 nm (violet laser diode module, 50 mW optical power), 532 nm (green-diode-pumped laser module, 50mW optical power) and 632.8 nm (He–Ne laser source, 35mW optical power) are properly combined (dichroic beam splitters) before impinging onto a pinhole (stainless steel aperture, 1 μm diameter). The pinhole provides a divergent spherical point source of RGB coherent illuminations with numerical apertures (NAs) values of 0.63/0.53/0.4 for RGB wavelengths, respectively. These 3 beams illuminate the sample at a short distance (d – z) from the pinhole plane as it corresponds with a LHM configuration for providing a reasonable magnification factor (typically between 5X and 20X). Then, a color CCD camera (AVT 1394 Stingray F-145C, 1388 × 1038 pixels, 6.45x6.45 μm pixel pitch) records the 3 RGB-coded Fresnel diffraction patters in a single CCD capture. The color CCD camera is placed at d and z distances from the pinhole and sample planes, respectively (see Fig. 1). After that, the information contained in the 3 CCD channels is digitally processed to finally obtain a high-resolution image without twin image contribution.

 figure: Fig. 1

Fig. 1 Experimental setup: (a) scheme and (b) picture from the lab.

Download Full Size | PDF

We have conducted experimental validation of our MISHELF microscope concept using 2 different configurations in the experimental layout. The first one is characterized by a low NA value and it is used to present in detail the digital image processing involved in the MISHELF algorithm. We have selected a positive United State Air Force (USAF) resolution test target to show in depth the algorithm steps. And the second implementation provides a medium NA value and it is applied to image a biological sample under quantitative phase imaging mode.

For the first experimental layout (low NA), we have forced the image to be square (1038 x 1038 pixels) just to simplify digital computing and optimize image visualization when presenting the figures. This fact does not suppose any penalty aside of deteriorating a bit the resolution limit in the reduced down image direction. The USAF test is placed at, approximately, 1.2 mm after the pinhole and at 24 mm in front of the CCD. Thus, the layout magnification factor M can be computed as the test’s geometric projection into the recording device in the form of: M = d/(d-z) ≅ 21X. Considering image (1038 pixels) and pixel (6.45 μm) sizes, the NA defined by our MISHELF microscope is NA = 0.14 (this is the previously referred low NA value) and the resolution limit for the shortest illumination wavelength is R = 0.82λ/NA = 2.37 μm.

In the second arrangement (medium NA), the experimental layout has been slightly modified reducing the distances between components in order to improve NA and hence the resolution limit. Moreover, we have considered full frame image (1388x1038 pixels) provided by the CCD. We have set d = 15 mm and z = 14 mm, so that M = 15X, NA = 0.30 (for the largest CCD direction), and R = 1.1 μm (according to that NA value and the blue wavelength). This configuration has been experimentally validated for a real biological sample, thus enabling sample’s visualization using qualitative and quantitative phase imaging modalities such as phase contrast, differential interference contrast (DIC), 3D representation, spiral phase contrast, etc.

2.2 Digital image processing

Our MISHELF microscope involves a novel and fast convergence algorithm for high-resolution quantitative phase imaging. The algorithm working flow diagram is represented through Fig. 2 where we want to stress that all the variables are spatially dependent (for instance: A0 = A0(x, y)) but we have not included the (x, y) coordinates at Fig. 2 to save space. The sample becomes illuminated with the trichromatic RGB source and one RGB hologram is recorded by the color CCD camera. This RGB hologram is then separated into its 3 elementary RGB channels providing 3 RGB color-coded holograms. After that, each hologram is subjected to an image equalization stage for improving them and consisting in 2 corrections: first, the illumination profile of each illumination beam is homogenized across the full frame to compensate the lower intensity at the borders; and second, the crosstalk resulting from the Bayer color filter array are subtracted from each channel to eliminate the contribution incoming from the other two complementary wavelengths. This image equalization stage needs to be done once and it involves basic (subtraction) digital image processing which can be easily implemented by preliminary calibration of the MISHELF microscope without sample.

 figure: Fig. 2

Fig. 2 Flow diagram of the MISHELF algorithm. After RGB illumination of the sample, the process starts with the recording at the CCD plane of a single RGB hologram (dashed red line frame). Then, arrows guide the way of reading (clockwise direction) until the Nth final iteration where the sample’s complex information is retrieved (solid red line frame). The variables I, A, U, O in the chart are (x, y)-spatially dependent.

Download Full Size | PDF

After that, the phase iteration algorithm starts with the definition of the initial amplitudes per each RGB wavelength (A0R,A0G,A0B) as the square root of the intensity distribution on each equalized RGB hologram (I0R,I0G,I0B). The 3 initial RGB amplitudes are propagated to its best focus and the resulting propagation distances are stored in the computer’s memory. Since refraction is wavelength dependent (the thickness of the sample’s slide slightly modifies the effective axial position of the sample because of the wavelength dependence in refractive index), the propagation distances per hologram are slightly different; so, MISHELF microscopy plays an equivalent role than a conventional LHM with only one wavelength but axially shifting the camera to record 3 in-line holograms at slightly different z distances. There are different numerical methods for digital reconstruction of the diffraction integral [32]. Among them, we have selected to solve the diffraction Rayleigh-Sommerfeld integral using convolution operation since it allows an effective and economical calculation without any approximation. After numerically propagation to the sample plane, the 3 in-focus images of the sample (O1R,O1G,O1B) are then used to synthesize a single fused image (O1).

To synthesize this fused image, we implement the following steps. First, we perform digital fast Fourier transform (FFT) of each in-focus images. Second, the global background phase for the 3 in-focus images is forced to be equal just to avoid phase cancellation when mixing their spectra. Third, the 3 spectra are then used to synthesize a new single spectrum incoming from a weighted addition of them. By weighted we mean that, because of the spatial frequency content contained on each image is different due to wavelength dependence of diffraction, the R spectrum contains a lower cutoff frequency than the G one which, in turn, is also lower than the cutoff frequency of the B spectrum. Thus, the information contained in the R spectrum is also included in the G one, and both are included in the B spectrum. So a weighted mask taken into account this fact is applied for not incurring in a low spatial frequency enhancement. And fourth, inverse FFT of the mixed spectrum recovers an improved image of the sample (O1), improved in the sense of noise averaging due to the mixing of the 3 images into a single one.

Such improved image becomes the input of a phase retrieval algorithm. The algorithm consists in the iterative application of back and forth numerical propagations between hologram and sample planes, but taking into account two peculiarities. On one hand, the improved image O1 is propagated 3 times taken into account the 3 propagation distances previously obtained in the first back propagation. Thus, 3 color coded holograms are generated at the CCD plane from which their phase distributions (φ1R,φ1G,φ1B) are retained while the amplitude ones (B1R,B1G,B1B) are replaced by the square root of the recorded hologram intensity (A0R,A0G,A0B). Then, the new complex amplitudes (A1R˜,A1G˜,A1B˜) are back propagated again (each one with its corresponding propagation distance) to their in-focus planes. And on the other hand, a new single and mixed spectrum is synthesized every time that one back and forth cycle is performed, that is, a new single image O1 is synthesized at the sample plane for each cycle in the algorithm. After a few number of iterations, a final image ON containing complex amplitude information of the sample is obtained with improved capabilities since it contains no information about the twin image and exhibits better image quality concerning noise, halos and contrast. Moreover, the single spectrum generation process allows fast convergence in the phase retrieval algorithm since information of the 3 channels is mixed together in each iteration. All together improves quantitative phase imaging of the sample which can be visualized under several imaging modalities such as 3D views, contrast images, plotting some regions of interest for profiling, etc.

For its better understanding, Fig. 3 presents a schematic chart of the algorithm steps when using the USAF test target as input sample. The RGB recorded hologram is separated into its 3 channels allowing direct focusing of the object on each one of them (upper row). These images can be improved by implementing the image previously commented equalization stage (Fig. 3 also includes the RGB illumination profiles without USAF test). Equalized in-focus images (lower row below the central RGB hologram) are then Fourier transformed and the new mixed spectrum is synthesized using the information contained at the RGB spectra considering a weighted mask for not incurring in spatial frequency enhancement. The new synthesized spectrum is Fourier transformed back to recover an improved image of the object (left image at the lower row). This image is the input for the phase retrieval algorithm previously exposed.

 figure: Fig. 3

Fig. 3 Schematic chart of the proposed digital stage processing in MISHELF microscopy for the USAF test target. The included images are represented by their intensity in order to allow direct comparison among them.

Download Full Size | PDF

3. Experimental validation

Aside of the USAF images presented in previous section, Fig. 4 shows a direct comparison of the USAF reconstructions obtained under different modalities of LHM using the low NA layout (0.14NA): (a) shows the image obtained under conventional LHM using blue illumination (B-LHM), (b) depicts the same image after image equalization stage, (c) presents the image obtained as inverse FFT after the first synthesized spectrum, and (d) shows the final image after phase retrieval with only 2 iterations (additional iterations do not improve the result). Images from (e) to (h) include a magnification of the USAF central part where the resolution limit is produced. Note that all the images included in Fig. 4 are intensity images depicted in Matlab with the same visualization power to allow direct comparison among them.

 figure: Fig. 4

Fig. 4 Intensity image comparison for the USAF test target in the low NA setup: (a) conventional single-wavelength (blue channel) LHM, (b) same than in (a) after image equalization stage, (c) image retrieved after the first object spectrum synthesis, and (d) the final image after 2 iterations of the phase retrieval algorithm. Images in (e) to (h) are the central magnified areas of (a) to (d), respectively. Scale bar in the lower-right corner of (d) is 50 μm in length.

Download Full Size | PDF

We can see as the resolution limit at all the images is the same and it corresponds with a value of 2.46 μm (Group 8-Element 5 as last resolved element), value which is in very good agreement with the theoretical one obtained for the B wavelength (see Section 2.1). However, image contrast is clearly enhanced and coherent noise averaged when comparing the MISHELF image with the conventional B- LHM one. Concerning the field of view (FOV), the black solid line in the lower right-corner of Fig. 4(d) has a length of 50 μm. So the total FOV width is around 280 μm. Assuming we are disregarding the borders of the image (black perimeter rectangle shown in last images of Fig. 3) due to border’s diffraction effects when performing numerical propagation, the CCD useful area is around 900 pixels width. This fact means that the FOV (280 μm) is framed in 5.8 mm, approximately, defining an experimental M value of 20.7X, value that also perfectly matches with the theoretical one (M = 21X). Note that the magnification factor is needed to avoid that the CCD sampling in Fresnel diffraction regime may be a limiting factor in the final image resolution. Moreover, because MISHELF technique uses a color CCD, the pixel number in each channel is not the maximum available (as it happens when using monochrome sensors in LHM); so, high magnifications must be pursued.

In addition, Fig. 5 includes the images obtained for a second experiment under the same experimental conditions (0.14NA) but considering now full frame image size (1388 × 1038 pixels). As in Fig. 4, we have compared the final recovered image by MISHELF microscopy [(c) and (d)] with the conventional single-wavelength B-LHM [(a) and (b)]. Although USAF object does not contains phase information because it is a real amplitude object, we have included phase distributions in Figs. 5(b) and 5(d) just to qualitatively show that phase image is also improved as consequence of the proposed method. Once again, images from (e) to (h) include a magnification of the central part of the USAF. Note as, because of the rectangular detection area, the resolution limit is not now the same on both orthogonal directions. Now, the last resolved element (Group 9-Element 2) in the largest CCD direction defines a resolution limit of 1.74 μm. This value is again in good agreement with the theoretical prediction because, now, we have 1388 pixels defining a NA value of 0.185NA and yielding in a resolution limit of 1.79 μm. Obviously, the NA value for the shortest direction is not changed (0.14NA) and the last resolved element is again the same one (Group 8-Element 5) than in the previous experiment.

 figure: Fig. 5

Fig. 5 Intensity and phase image comparison for the USAF test target in the low NA setup with full frame recording area: (a) and (b) are the intensity and phase images using conventional single-wavelength (blue channel) LHM, respectively, and (c) and (d) are the intensity and phase images retrieved after 2 iterations of the phase retrieval algorithm, respectively. Images in (e) to (h) are the central magnified areas of (a) to (d), respectively.

Download Full Size | PDF

To clearly show that twin image is eliminated due to the phase retrieval algorithm, we have included two video movies corresponding with conventional B-LHM (Visualization 1) and MISHELF microscopy (Visualization 2). The first frame at both videos corresponds with and in-focus image of the USAF test and then digital propagation to the twin image plane (last frame of the movies) is applied. Figure 6 presents the propagated images to the plane where the twin image is located. One can see as conventional B-LHM contains twin image contribution while MISHELF microscopy eliminates the twin image (no USAF image in the last movie frame).

 figure: Fig. 6

Fig. 6 Twin image removal validation: (a) B channel image (see Visualization 1) and (b) final image provided by MISHELF microscopy (see Visualization 2) at the plane where twin image is located.

Download Full Size | PDF

Now, the medium NA layout (0.3NA) is assembled and MISHELF microscope is tested for a biological sample in order to show quantitative phase imaging capabilities. The biological sample is an unstained swine sperm sample (head width of 6x9 μm, total length of 55 μm, and a tail’s width of 2 μm on the head side and below 1 μm on the end, approximately) which is dried up for fixing the sperm cells in the counting chamber. According to the theoretical values (see Section 2.1), the resolution limit is enough to resolve the sperm tails in the neck side while it is not at their end. Figure 7 show the experimental results of the MISHELF microscope in comparison with the ones obtained when using single-wavelength (blue) conventional LHM. Figures 7(a)-7(b) show, respectively, the RGB and the B-LHM holograms while images in Figs. 7(c)-(d) present the intensity images provided by MISHELF microscope after 2 phase retrieval algorithm iterations and B-LHM, respectively. As in the USAF case, one can see as MISHEL microscopy provides a global contrast enhancement and background noise reduction along the whole image.

 figure: Fig. 7

Fig. 7 Intensity biosample results: (a)-(b) are the holograms and (c)-(d) includes the final intensity images of the framed areas (solid white line squares) included in (a)-(b), respectively, for the proposed MISHELF microscope and the conventional single-wavelength (B channel) LHM case. Scale bars in the images are 100 μm in length.

Download Full Size | PDF

Nevertheless, the biosample contains valuable phase information which provides qualitative (improved visualization modes) as well as quantitative (capability of measure cell’s profile) information about the sperm cells. Figure 8 includes a comparison of the images which can be obtained. First row presents the images in positive phase contrast modality while second row show negative phase contrast images. We have included the images obtained from MISHELF microscopy [Figs. 8(a) and 8(e)] as well as the single-wavelength conventional LHM for R-G-B illuminations [Figs. 8(d) and 8(h), 8(c) and 8(g), and 8(b) and 8(f), respectively]. One can visualize the noise reduction concerning twin image elimination, background homogeneity, coherent artifacts, spurious reflections, etc. resulting in a global image quality improvement. Moreover, resolution is not penalized since, as previously for the USAF case, MISHELF microscopy retains the resolution limit provided by the best (the lower) illumination wavelength.

 figure: Fig. 8

Fig. 8 Phase visualizations of the biosample: (a)-(d) and (e)-(h) are positive and negative phase contrast images, respectively obtained from MISHELF microscopy [(a) and (e)], B-LHM [(b) and (f)], G-LHM [(c) and (g)] and R-LHM [(d) and (h)]. Images in (i) and (j) represent a 3D view of the phase unwrapped distributions incoming from the MISHELF microscope and for the conventional B-LHM, respectively, where gray scale bars represents optical phase in radians. Scale bars in (a)-(d) images are 100 μm in length.

Download Full Size | PDF

All those qualitative images are supplemented with quantitative information incoming from the 3D representation of the retrieved unwrapped phase distribution. Figure 8 presents a comparison of the biosample’s 3D phase profile when considering the MISHELF microscope and the B-LHM images. We have computed the Standard Deviation (STD) of the background noise in order to compare the phase stability derived from MISHELF microscopy and conventional B-LHM. The STD values are computed at the two regions marked with dotted black line rectangles in the phase profiles included in Fig. 9. Note that no sperm cells are contained at both areas and that phase values have been normalized previous to the STD calculation, thus allowing direct comparison of the phase noise stability. We have obtained 0.028 and 0.062 rads averaged STD values for MISEHLF microscopy and B-LHM, respectively, meaning that a factor a bit higher than 2 is obtained in phase stability improvement as consequence of the proposed algorithm.

 figure: Fig. 9

Fig. 9 Phase visualizations of the biosample: (a) and (b) represent a 3D plot of the phase unwrapped distributions incoming from the MISHELF microscope and for the conventional B-LHM, respectively. Gray scale bars represent optical phase in radians. The dotted black line rectangles are used to compare STD values of the background.

Download Full Size | PDF

In addition, the recovered phase distribution can also be digitally manipulated to generate a wide variety of phase visualization images in a similar way than optical procedures allow. The main advantage is that the imaging synthesis is performed numerically instead of optically, that is, there is no need to change to special lenses or illumination systems in order to provide such images. Figure 10 depicts a set of digitally-processed classical images for phase visualization incoming from the complex amplitude distribution retrieved by MISHELF microscopy. We present: Fig. 10(a) the darkfield image by blocking the DC term at the Fourier plane, Fig. 10(b) and Fig. 10(c) the DIC images by subtracting two displaced images in the horizontal and vertical directions, respectively, and Fig. 10(d) a spiral phase contrast imaging by adding a spiral phase mask at the Fourier plane. One can observe that each modality enhances the visibility and contrast of different features of the biosample.

 figure: Fig. 10

Fig. 10 Digital post-processing biosamples images from the MISHELF recovered complex amplitude distribution: (a) darkfield image, (b) and (c) DIC images in the horizontal and vertical directions, respectively, and (d) spiral phase contrast image.

Download Full Size | PDF

Finally and aside of improving qualitative and quantitative phase image quality, the proposed new algorithm also improves convergence in the phase retrieval procedure. For instance, in [19] Zhang et al. report on a digital in-line holographic layout where 3 holograms are acquired by axially shifting the camera instead of using 3 wavelengths. According to [19], the phase distribution is retrieved after 75 iterations of the phase retrieval algorithm that performs numerical propagation between the 3 recording planes. The number of iterations is reduced until 30 [30] by using 3 wavelengths with a single and static monochrome camera. Note that nothing is stated concerning the phase retrieval algorithm [31] but that “a few iterations” are needed and that “the same reconstruction procedure” as in [30] is used. Here, we have reported on superior image quality than the previous RGB multi-wavelength Fresnel diffraction imaging incoming from a higher resolution limit (0.3NA), a significantly improved visualization of phase through multiple phase imaging modes, and a fast algorithm convergence incoming from a reduced number of iterations. The last sentence is supported by the fact that images included along this manuscript only need 2 iterations in the phase retrieval cycle for both USAF and biosample cases. A similar phase retrieval procedure but without RGB spectrum synthesis (only considering a single wavelength) and applying known constraints about the input object (pure phase or amplitude object) needs around 15-30 iterations (depending on the object type) for twin image elimination [10]; so, the digital processing reported in this manuscript greatly improves algorithm convergence.

4. Discussion and conclusions

In this manuscript, we have provided a step forward on a recently reported LHM method based on wavelength multiplexing digital in-line holography in the Fresnel domain [31] but with improved capabilities. The technique, named here as MISHELF microscopy, is based on the simultaneous illumination of the sample with a trichromatic (RGB wavelengths) laser source and the recording of a single-shot multiplexed hologram containing information about the 3 wavelength-coded Fresnel patterns diffracted by the sample. Coherent trichromatic illumination is accomplished by combining three independent laser sources over a single illumination pinhole and simultaneous recording of the 3 Fresnel patters is achieved by single snap-shot of a color CCD camera.

Although the use of multiple illumination wavelengths in LHM has been previously reported in the literature [33–36], their use was restricted to pseudocolor image rendering [33,34,36] and/or multispectral analysis [33,35] of the sample. In MISHELF microscopy, RGB illuminations are used for phase retrieval and quantitative phase imaging in single exposure LHM, in addition to the previously commented color imaging capabilities.

Concerning similarities with [31], MISHELF microscopy differs from and improves quantitative phase imaging in the following. First, it uses a pinhole as illumination source instead coupling the lasers to a single-mode fiber. Single-mode fibers permits low NAs in illumination (typically in the range of 0.1NA), so resolution is highly compromised by this low NA value, even more considering that the real useful NA is usually smaller than its theoretical value due to the intensity decreasing at the borders. However, medium (in the range of 0.4-0.5) NA values are easily accessible by using a pinhole for illumination, as usually is in digital in-line holography [1,3,9,34,35], thus improving the resolution of the final image. In this manuscript, the hardware has been improved allowing the definition of medium NA values (in the range of 0.3), meaning that resolution limits close to 1 micron are accessible.

Second, our novel phase retrieval algorithm converges extremely faster than others because it mixes together information incoming from the 3 RGB channels. The improvement in image quality is not only as consequence of the weighted mask (spatial-frequency enhancement or band-pass filtering must be avoided) but due to the fact of mixing 3 images into a single one. In addition, this fact results in a reduction of the processing time to a few seconds when using standard desktop computers. Note that the algorithm reported in [30,31] is not exposed in depth and converges to a final image after 30 iterations [30], meaning about 1 min of processing time on a standard desktop computer. MISHELF microscopy algorithm has demonstrated similar (if not superior) image quality retrieval with only 2 iterations.

And third, the final image presents noise reduction and improved image quality incoming from both a qualitative and a quantitative point of views. Qualitatively, MISHELF images present enhanced contrast, halos and coherent noise reduction, twin image elimination, higher background homogeneity, and reduction of coherent artifacts and spurious reflections in comparison with conventional single-wavelength LHM. And quantitatively, all those image quality enhancements derive in phase noise reduction through the definition of lower STD values.

In summary, we have reported on MISHELF microscopy from a double point of view. First, the hardware has been improved allowing the definition of medium NA values (in the range of 0.3), meaning that resolution limits close to 1 micron are accessible. And second, the software has also been improved and optimized through a novel phase retrieval algorithm based on a customized management of the information provided by the 3 illuminations at the Fourier domain. The final images obtained by our MISHELF microscope embodiment provide quantitative phase imaging improvement as well as increase the convergence of similar algorithms through reducing the number of iterations needed to get the final image. Moreover, since the retrieved quantitative phase distribution is obtained in a single camera snap-shot, the limiting factor for imaging dynamic biological events is the camera acquisition rate thus enabling video-rate movies of the inspected samples. Experimental results have been presented validating all previous statements concerning MISHELF microscopy. The synthetic object (USAF resolution test target) case provides useful images for layout calibration and algorithm in-depth presentation. And the biological sample (swine sperm sample) shows different qualitative and quantitative phase imaging modalities.

Acknowledgments

We thank Prof. Carles Soler and Francisco Blasco from Proiser R + D S.L. for providing the swine sperm sample. Part of this work has been funded by the Spanish Ministerio de Economía y Competitividad and the Fondo Europeo de Desarrollo Regional (FEDER) under the project FIS2013-47548-P.

References and links

1. W. Xu, M. H. Jericho, I. A. Meinertzhagen, and H. J. Kreuzer, “Digital in-line holography for biological applications,” Proc. Natl. Acad. Sci. U.S.A. 98(20), 11301–11305 (2001). [CrossRef]   [PubMed]  

2. T.-W. Su, L. Xue, and A. Ozcan, “High-throughput lensfree 3D tracking of human sperms reveals rare statistics of helical trajectories,” Proc. Natl. Acad. Sci. U.S.A. 109(40), 16018–16022 (2012). [CrossRef]   [PubMed]  

3. S. K. Jericho, J. Garcia-Sucerquia, W. Xu, M. H. Jericho, and H. J. Kreuzer, “Submersible digital in-line holographic microscope,” Rev. Sci. Instrum. 77(4), 043706 (2006). [CrossRef]  

4. A. Greenbaum, W. Luo, T.-W. Su, Z. Göröcs, L. Xue, S. O. Isikman, A. F. Coskun, O. Mudanyali, and A. Ozcan, “Imaging without lenses: achievements and remaining challenges of wide-field on-chip microscopy,” Nat. Methods 9(9), 889–895 (2012). [CrossRef]   [PubMed]  

5. M. Lee, O. Yaglidere, and A. Ozcan, “Field-portable reflection and transmission microscopy based on lensless holography,” Biomed. Opt. Express 2(9), 2721–2730 (2011). [CrossRef]   [PubMed]  

6. W. Bishara, H. Zhu, and A. Ozcan, “Holographic opto-fluidic microscopy,” Opt. Express 18(26), 27499–27510 (2010). [CrossRef]   [PubMed]  

7. D. Gabor, “A new microscopic principle,” Nature 161(4098), 777–778 (1948). [CrossRef]   [PubMed]  

8. G. L. Rogers, “Experiments in diffraction microscopy,” Proc. - R. Soc. Edinburgh, Sect. A: Math. 63, 193–221 (1952).

9. L. Repetto, E. Piano, and C. Pontiggia, “Lensless digital holographic microscope with light-emitting diode illumination,” Opt. Lett. 29(10), 1132–1134 (2004). [CrossRef]   [PubMed]  

10. B. Perucho and V. Micó, “Wavefront holoscopy: application of digital in-line holography for the inspection of engraved marks in progressive addition lenses,” J. Biomed. Opt. 19(1), 016017 (2014). [CrossRef]   [PubMed]  

11. O. Mendoza-Yero, A. Calabuig, E. Tajahuerce, J. Lancis, P. Andrés, and J. Garcia-Sucerquia, “Femtosecond digital lensless holographic microscopy to image biological samples,” Opt. Lett. 38(17), 3205–3207 (2013). [CrossRef]   [PubMed]  

12. Z. Frentz, S. Kuehn, D. Hekstra, and S. Leibler, “Microbial population dynamics by digital in-line holographic microscopy,” Rev. Sci. Instrum. 81(8), 084301 (2010). [CrossRef]   [PubMed]  

13. A. Greenbaum and A. Ozcan, “Maskless imaging of dense samples using pixel super-resolution based multi-height lensfree on-chip microscopy,” Opt. Express 20(3), 3129–3143 (2012). [CrossRef]   [PubMed]  

14. M. Guizar-Sicairos and J. R. Fienup, “Understanding the twin-image problem in phase retrieval,” J. Opt. Soc. Am. A 29(11), 2367–2375 (2012). [CrossRef]   [PubMed]  

15. I. Yamaguchi and T. Zhang, “Phase-shifting digital holography,” Opt. Lett. 22(16), 1268–1270 (1997). [CrossRef]   [PubMed]  

16. T. Zhang and I. Yamaguchi, “Three-dimensional microscopy with phase-shifting digital holography,” Opt. Lett. 23(15), 1221–1223 (1998). [CrossRef]   [PubMed]  

17. V. Micó, J. García, Z. Zalevsky, and B. Javidi, “Phase-shifting Gabor holography,” Opt. Lett. 34(10), 1492–1494 (2009). [CrossRef]   [PubMed]  

18. V. Micó and J. García, “Common-path phase-shifting lensless holographic microscopy,” Opt. Lett. 35(23), 3919–3921 (2010). [CrossRef]   [PubMed]  

19. Y. Zhang, G. Pedrini, W. Osten, and H. Tiziani, “Whole optical wave field reconstruction from double or multi in-line holograms by phase retrieval algorithm,” Opt. Express 11(24), 3234–3241 (2003). [CrossRef]   [PubMed]  

20. G. Pedrini, W. Osten, and Y. Zhang, “Wave-front reconstruction from a sequence of interferograms recorded at different planes,” Opt. Lett. 30(8), 833–835 (2005). [CrossRef]   [PubMed]  

21. P. Bao, F. Zhang, G. Pedrini, and W. Osten, “Phase retrieval using multiple illumination wavelengths,” Opt. Lett. 33(4), 309–311 (2008). [CrossRef]   [PubMed]  

22. P. Bao, G. Situ, G. Pedrini, and W. Osten, “Lensless phase microscopy using phase retrieval with multiple illumination wavelengths,” Appl. Opt. 51(22), 5486–5494 (2012). [CrossRef]   [PubMed]  

23. L. Camacho, V. Micó, Z. Zalevsky, and J. García, “Quantitative phase microscopy using defocusing by means of a spatial light modulator,” Opt. Express 18(7), 6755–6766 (2010). [CrossRef]   [PubMed]  

24. M. R. Teague, “Deterministic phase retrieval: a Green’s function solution,” J. Opt. Soc. Am. 73(11), 1434–1441 (1983). [CrossRef]  

25. N. Streibl, “Phase imaging by the transport equation of intensity,” Opt. Commun. 49(1), 6–10 (1984). [CrossRef]  

26. D. Paganin and K. Nugent, “Noninterferometric phase imaging with partially coherent light,” Phys. Rev. Lett. 80(12), 2586–2589 (1998). [CrossRef]  

27. M. Beleggia, M. A. Schofield, V. V. Volkov, and Y. Zhu, “On the transport of intensity technique for phase retrieval,” Ultramicroscopy 102(1), 37–49 (2004). [CrossRef]   [PubMed]  

28. L. Waller, S. S. Kou, C. J. R. Sheppard, and G. Barbastathis, “Phase from chromatic aberrations,” Opt. Express 18(22), 22817–22825 (2010). [CrossRef]   [PubMed]  

29. S. Witte, V. T. Tenner, D. W. E. Noom, and K. S. E. Eikema, “Lensless diffractive imaging with ultra broad-band table-top sources: from infrared to extreme-ultraviolet wavelengths,” Light Sci. Appl. 3(3), e163 (2014). [CrossRef]  

30. D. W. E. Noom, K. S. E. Eikema, and S. Witte, “Lensless phase contrast microscopy based on multiwavelength Fresnel diffraction,” Opt. Lett. 39(2), 193–196 (2014). [CrossRef]   [PubMed]  

31. D. W. E. Noom, D. E. Boonzajer Flaes, E. Labordus, K. S. E. Eikema, and S. Witte, “High-speed multi-wavelength Fresnel diffraction imaging,” Opt. Express 22(25), 30504–30511 (2014). [CrossRef]   [PubMed]  

32. T. Kreis, Handbook of Holographic Interferometry: Optical and Digital Methods (Wiley-VCH Verlag & Co., 2005).

33. J. P. Ryle, S. McDonnell, and J. T. Sheridan, “Lensless multispectral digital in-line holographic microscope,” J. Biomed. Opt. 16(12), 126004 (2011). [CrossRef]   [PubMed]  

34. J. Garcia-Sucerquia, “Color lensless digital holographic microscopy with micrometer resolution,” Opt. Lett. 37(10), 1724–1726 (2012). [CrossRef]   [PubMed]  

35. O. Mendoza-Yero, E. Tajahuerce, J. Lancis, and J. Garcia-Sucerquia, “Diffractive digital lensless holographic microscopy with fine spectral tuning,” Opt. Lett. 38(12), 2107–2109 (2013). [CrossRef]   [PubMed]  

36. A. Greenbaum, A. Feizi, N. Akbari, and A. Ozcan, “Wide-field computational color imaging using pixel super-resolved on-chip microscopy,” Opt. Express 21(10), 12469–12483 (2013). [CrossRef]   [PubMed]  

Supplementary Material (2)

NameDescription
Visualization 1: MOV (5217 KB)      Twin image removal validation: B channel image (see Visualization 1) at the plane where twin image is located
Visualization 2: MOV (3934 KB)      Twin image removal validation: final image provided by MISHELF microscopy (see Visualization 2) at the plane where twin image is located

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (10)

Fig. 1
Fig. 1 Experimental setup: (a) scheme and (b) picture from the lab.
Fig. 2
Fig. 2 Flow diagram of the MISHELF algorithm. After RGB illumination of the sample, the process starts with the recording at the CCD plane of a single RGB hologram (dashed red line frame). Then, arrows guide the way of reading (clockwise direction) until the Nth final iteration where the sample’s complex information is retrieved (solid red line frame). The variables I, A, U, O in the chart are (x, y)-spatially dependent.
Fig. 3
Fig. 3 Schematic chart of the proposed digital stage processing in MISHELF microscopy for the USAF test target. The included images are represented by their intensity in order to allow direct comparison among them.
Fig. 4
Fig. 4 Intensity image comparison for the USAF test target in the low NA setup: (a) conventional single-wavelength (blue channel) LHM, (b) same than in (a) after image equalization stage, (c) image retrieved after the first object spectrum synthesis, and (d) the final image after 2 iterations of the phase retrieval algorithm. Images in (e) to (h) are the central magnified areas of (a) to (d), respectively. Scale bar in the lower-right corner of (d) is 50 μm in length.
Fig. 5
Fig. 5 Intensity and phase image comparison for the USAF test target in the low NA setup with full frame recording area: (a) and (b) are the intensity and phase images using conventional single-wavelength (blue channel) LHM, respectively, and (c) and (d) are the intensity and phase images retrieved after 2 iterations of the phase retrieval algorithm, respectively. Images in (e) to (h) are the central magnified areas of (a) to (d), respectively.
Fig. 6
Fig. 6 Twin image removal validation: (a) B channel image (see Visualization 1) and (b) final image provided by MISHELF microscopy (see Visualization 2) at the plane where twin image is located.
Fig. 7
Fig. 7 Intensity biosample results: (a)-(b) are the holograms and (c)-(d) includes the final intensity images of the framed areas (solid white line squares) included in (a)-(b), respectively, for the proposed MISHELF microscope and the conventional single-wavelength (B channel) LHM case. Scale bars in the images are 100 μm in length.
Fig. 8
Fig. 8 Phase visualizations of the biosample: (a)-(d) and (e)-(h) are positive and negative phase contrast images, respectively obtained from MISHELF microscopy [(a) and (e)], B-LHM [(b) and (f)], G-LHM [(c) and (g)] and R-LHM [(d) and (h)]. Images in (i) and (j) represent a 3D view of the phase unwrapped distributions incoming from the MISHELF microscope and for the conventional B-LHM, respectively, where gray scale bars represents optical phase in radians. Scale bars in (a)-(d) images are 100 μm in length.
Fig. 9
Fig. 9 Phase visualizations of the biosample: (a) and (b) represent a 3D plot of the phase unwrapped distributions incoming from the MISHELF microscope and for the conventional B-LHM, respectively. Gray scale bars represent optical phase in radians. The dotted black line rectangles are used to compare STD values of the background.
Fig. 10
Fig. 10 Digital post-processing biosamples images from the MISHELF recovered complex amplitude distribution: (a) darkfield image, (b) and (c) DIC images in the horizontal and vertical directions, respectively, and (d) spiral phase contrast image.
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.