Abstract
A holographic 3D printer produces a high-quality 3D image reproduced by a full-color, full-parallax holographic stereogram with high-density light-ray recording. In order to produce a high-resolution holographic stereogram, we have to solve the problem of speckle noise in this system. For equalizing an intensity distribution inside the elementary hologram, the object beam is modulated by a diffuser. However the diffuser typically generates speckles, which is recorded in the holographic stereogram. It is localized behind the reconstructed image as a granularity noise. First we show the problems of some conventional ways for suppressing the granularity noise using a band-limited diffuser, and then we analyze an approach using a moving diffuser for the reduction of this noise. In the result, it is found that recording with a moving diffuser is effective for reducing the granularity noise at infinity of reconstructed image, although an alternative noise occurs. Moreover we propose a new method introducing multiple exposures to suppress the noise effectively.
©2013 Optical Society of America
1. Introduction
A holographic 3D printer produces a holographic stereogram (HS) using the three dimensional (3D) data of a subject from a computer and outputs a hardcopy of 3D image like a conventional image printer [1–3]. The image obtained by this system has full-color, full-parallax and high-density light-ray information.
In this system, by use of the optical system shown in Fig. 1 , an array of small elementary reflection-type holograms is recorded in a thick recording material. The recording medium is translated horizontally and vertically after each exposure so that the whole surface of the hologram is exposed by an array of small elementary holograms. An aperture is placed to avoid leaking the object beam to the adjacent elementary holograms. The image displayed on a spatial light modulator (SLM), in this case a liquid-crystal display (LCD) panel, is a geometrical projection of the 3D object calculated by a computer-graphic technique. In the reconstruction stage, since each elementary hologram is a volume reflection grating, full-parallax 3D image can be displayed under an ordinary white light illumination.
Since the recording medium is placed on the Fourier plane, the intensity variation on the hologram plane depends on the spatial frequency component of the image displayed on the SLM. This image usually has a small high-frequency component. The phase distribution is almost dependent on the amplitude pattern since the phase is also modulated along with the amplitude by the LCD panel. Therefore the low-frequency component is dominant even in the phase pattern, and the object beam has a strong zero frequency peak. As a result, two problems occur, (1) the recording of a hologram with high efficiency is difficult because the dynamic range of the recording medium is limited, and (2) the reconstructed image is affected by dark spacing between the elementary holograms due to the low aperture ratio.
To solve these problems, several ways have been proposed. To smooth the Fourier spectrum distribution, one may simply move the recording medium slightly away from the focal plane so that the intensity becomes almost uniform by defocus [4]. Then, however, the problem of the low aperture ratio remains.
Another method is to use a phase modulation. Using a diffuser to equalize the Fourier spectrum within the aperture causes a loss of the object beam and generates speckles, which are recorded with LCD image. This recorded speckle pattern appears behind the reconstructed image as a granulated pattern. We call it “granularity noise” in this paper. A granularity noise is originated from speckles, which are generated by a diffuser and recorded in an elementary hologram. Therefore various phase masks called band-limited diffuser, proposed for the holographic memory applications [5–14], have been employed. However, these optimized phase masks cannot reduce the granularity noise sufficiently under the terms of equalizing the Fourier spectrum. This is described in the section 2.
In this paper, we analyze a “moving diffuser method”. This method was tried in the HS with horizontal parallax only (HPO) [15], but details of the experimental result have not been reported. We first apply this method to holographic 3D printer that generates full-parallax HS. In the result, we found through experiments that this method can reduce the granularity noise localized behind the reconstructed image, although alternative high-frequency noise appeared on the hologram plane. This is described in section 3. To avoid these problems, we discuss introducing multiple exposures in section 4. In this approach, effective granularity noise reduction is possible.
2. Limitation of band-limited diffusers
2.1 The problem: Granularity noise
If HS is recorded with a typical diffuser, a speckle pattern due to a low pass filtering by the aperture in Fig. 1 affects the LCD image and is recorded in the elementary hologram. When using the static diffuser, since a same speckle pattern is recorded in all elementary holograms, this pattern becomes localized at infinity of the reconstructed image as granularity noise. An average size of the granularity depends on the aperture size, and the smaller the aperture size is made for high-density recording of elementary holograms, the more apparent the granularity noise becomes because of larger granularity size. It also means that a granular size doesn't change even though the frequency of the diffuser mask is altered. If we can make the frequency of granularity noise very high, this problem is solved. However, this is unrealizable because to increase the frequency of granularity noise, we have to employ an aperture of large size or a high numerical aperture (NA) lens. The former means large elementary holograms and decrease the HS resolution, and the latter is limited in point of implementation. Therefore this is a critical problem for high-density HS recording. Then, band-limited diffusers have been studied to solve this problem.
2.2 Band-limited diffuser
Band-limited diffusers optimized to Fourier transform holograms have been analyzed for holographic data storage applications [5–12,16] and also have been applied to HS recording [17–19]. However, the problem of this method has not been described in detail. In this paper, we describe the characteristics of one of the band-limited diffusers called digital diffuser, which is designed by a digital process. Digital diffusers can be categorized in two groups: object-independent and object-dependent diffusers [18]. Since the former is more practical in point of implementation, we describe only the former.
An object-independent diffuser is one of the phase masks, which have rectangular phase cells. It is placed back of the LCD and modulates the phase of the object beam to equalize the Fourier spectrum in the HS recording. The phase is designed not to generate speckles. As the designing method fitting the HS recording, there are pseudorandom phase sequences (PRPS) [11] and iterative Fourier transform algorithm (IFTA) [13].
2.3 Evaluation
We evaluate smoothness within the aperture on the hologram plane and a speckle contrast [20] of the LCD plane after the low pass filtering by a numerical simulation. The smoothness “S” and the speckle contrast “C”are written as:
whereand are the intensity of the Fourier plane and the LCD plane, max means a maximal value, means a spatial average and is a standard deviation of .2.4 Pseudo random phase sequence (PRPS)
PRPS is simply designed to the adjacent phase difference to be constant. Fitting the aperture size to the main lobe of the Fourier spectrum, it is possible to equalize the Fourier spectrum within the aperture. The results of 4level-PRPS, 6level-complex-PRPS [11] and 2level-random phases [5] are shown in Fig. 2 . The phase differences of the adjacent cells generate an intensity difference at the reconstructed light distribution by low pass filtering of the aperture. It makes the characteristic pattern shown in Fig. 2(a)~(c) and affect the LCD image. This pattern is reconstructed as angular distribution, which forms an image at infinity and causes quality reduction.
2.5 Iterative Fourier transform algorithm (IFTA)
The algorithm of IFTA is described in [13,14]. In this algorithm, smoothness S can be controlled by changing the clipping level of the Fourier domain constraint. Therefore, we calculated the relation between S and C in numerical simulations as shown in Fig. 3 . A part of results is shown in Fig. 4 . These results indicate that there is a trade-off between the smoothness and the speckle contrast. It means that the more increase the aperture ratio, the more the granularity noise appears at infinity. We can understand that this is a limitation of single exposure with digital diffusers.
3. HS recording with moving diffuser
3.1 Principle
A moving diffuser method is another way to reduce the granularity noise in HS. Moving a typical diffuser after each exposure step, uncorrelated speckle patterns are recorded in each elementary hologram with the LCD image. When observer focuses on infinity of the reconstructed image, these patterns are superposed at observer’s retina since HS is reconstructed with incoherent light as shown in Fig. 5 . Superposing the uncorrelated granularity pattern, granularity noise contrast is reduced in inversely proportion to the square root of the number of superposed images like the case of speckle contrast [20]. In this way, the granularity noise contrast at infinity can be reduced.
We evaluate this effect quantitatively through experiments with the granularity noise contrast appeared at infinity and the noise energy at the hologram plane represented by the power spectral density [21]. Figure 6 shows the reconstructed image recorded with and without a moving diffuser. In the result, the moving diffuser could effectively reduce the granularity noise at infinity as shown in Fig. 6(d), and this effect almost agreed with the theoretical value. However, when the observer focused on the hologram plane, alternative noise was perceived as shown in Fig. 6(c). Following sections describe the detail.
3.2 Granularity noise at infinity
The infinity noise is evaluated through experiments quantitatively in a setup like Fig. 7(a) . The pattern on the observer's retina when it focuses on infinity is optically simulated on a charge-coupled device (CCD) image sensor, and granularity noise contrast is calculated with Eq. (1) that is the same definition as speckle contrast. Then we also use “C” as granularity noise contrast. In this case the elementary hologram size D is 200μm. A diffuser is vertically translated after each exposure by a z-axis stage. A diode pumped solid state laser of 532nm is used for HS recording in the experiment. Figure 7(b) shows the relation between the granularity noise contrast C and the number of phase patterns M, which correspond to the number of illuminated positions on the diffuser. Figure 8 shows the examples of the granularity noise images captured by the experiment. The granularity noise contrast at infinity reduces in proportion to 1/ theoretically because this is the same as the case of full-developed speckle [20]. Then a theoretical value can be calculated by
where is an initial granularity noise contrast (corresponding to M = 1) and is the contrast of the noise originated from the optical systems, which is measured with a white plate instead of the HS. To reduce the effect of unevenness of the object beam distribution before the LCD, the contrast is averaging by small segments. This result shows that the granularity noise contrast (depicted as ) is almost reduced in proportion to 1/ fitting to the theoretical value. Because of the dynamic range limitation and nonlinearity of the recording medium, while the speckles in the HS recording is a full-developed speckle, doesn't become unity.The number of rays toward the same direction entering the observer’s pupil determines the limitation of the granularity noise reduction by this approach as shown in Fig. 5. When the diameter of the pupil is 3.5mm and the pitch of the elementary hologram is 200μm, about 250 rays superposed on the retina, so that the limitation of the granularity noise reduction effect becomes 1/≈0.063.
3.3 High-frequency noise at hologram plane
As mentioned in the section 3.1, it was found that a high-frequency noise appeared on the surface of the reconstructed HS (hologram plane) as shown in Fig. 6(c). The quantitative evaluation of the noise at the hologram plane was carried out by the setup of Fig. 9(a) . We evaluated the image captured by a CCD camera, which focus on the hologram plane, using one dimensional power spectral density. The noise energy is calculated by the sum of the power spectrum in the frequency range lower than the elementary hologram pitch, excluding zero-order. In this experiment, the camera was adjusted to the same condition that HS was placed at 200mm from an observer whose eye pupil was 3.5 mm diameter. The relation between the number of phase pattern M and the energy of this noise are shown in “Single exposure” of Fig. 9(b).
When recording by a static diffuser, a very low frequency noise appears at the hologram plane, and this noise does not bother the reconstructed image while the infinity noise is more noticeable. When using a moving diffuser, since each elementary hologram reconstructs the granulated pattern that is different from each other, observer perceives a luminance variation at the elementary holograms when focusing on the hologram plane as shown in Fig. 10 . This noise is perceived when the value of M becomes large to some extent as shown in Fig. 9(b), and the pitch of the elementary hologram determines the maximum frequency. Also, since this high frequency noise is originated from the granularity pattern recorded in each elementary hologram, we cannot suppress it by increasing the frequency of the diffuser as described in section 2.1. In addition, when moving the point of view, the high-frequency noise is perceived as a flicker. This is the problem of the moving diffuser method.
4. HS recording with multiple exposures
4.1 Multiple exposures with uncorrelated random phase
The moving diffuser method is effective to reduce the granularity noise behind the reconstructed image, but has the problem of the high-frequency noise at the hologram plane. In this section, we propose a new method to solve this problem. Recent years, a number of studies about photo-polymers have been developed for holographic data storage applications, which uses multiple exposures. Therefore, we consider applying the multiple exposures to reduce the granularity noise in HS. For example, an elementary hologram is recorded by multiple exposures to several times (M times) while the diffuser is shifted after each exposure. Then, if each speckle pattern recorded in the single elementary hologram is uncorrelated, the granularity noise reconstructed from the single elementary hologram reduces in proportion to 1/ so that the noise on the retina also reduced. Then high-frequency noise at the hologram plane does not appear in case of the multiple exposures using same sets of positions on the diffuser. In this way, only the granularity noise behind the reconstructed image can be reduced without increasing the high-frequency noise on the hologram plane. The result of experimental evaluation is shown in “” of Fig. 7(b) and “Multiple exposures” of Fig. 9(b). These results indicate that the multiple exposures with uncorrelated phases can reduce the granularity noise contrast in proportion to 1/ without the high-frequency noise until 4 times exposures, although cannot reduce when 8 times exposures. The reason can be considered that the exposure condition becomes difficult as increasing the number of multiple exposures since the linearity of the sensitivity in recording medium is limited. Therefore, the number of multiple exposures cannot be increase so much because it takes a large recording time to shift the diffuser and the diffraction efficiency is affected by multiple exposures. It means that the factor of 1/ is inefficient. If it is possible that each speckle pattern recorded by multiple exposures have a negative correlation, we can reduce the speckle contrast effectively smaller than 1/. In the application of a laser display, this concept has already been proposed [22].
4.2 Proposed method
According to the concept described above, we propose a new method for the granularity noise reduction in HS. Let us consider the phase modulation with a digital diffuser designed by 4level-PRPS. It has the random phase sequences in which the phase step at each boundary is either + π/2 or -π/2. When the size of the elementary hologram D is 2λf/p, where f, λ and p denote the focal length, the wavelength and the pitch of phase cell respectively, the reconstructed image recorded by 4level-PRPS becomes a dot-like pattern as shown in Fig. 2(b). Exposing an elementary hologram four times with shifting the diffuser half-length of the phase cell pitch, the dot-like pattern reconstructed from the elementary hologram is superposed incoherently as shown in Fig. 11 . Then, since the dot-like pattern and its shifted pattern have a negative correlation, the speckle contrast is effectively reduced.
4.3 Simulation and experiment
Figure 12(a,d) shows the result of proposed method by numerical simulation. The granularity noise contrast is reduced almost 0.105 even as 1/ = 0.5 in the case of using uncorrelated phases with M = 4. This means that it is effective compared to the approach with a typical moving diffuser (uncorrelated phases) and multiple exposures.
Next, we confirm the effect of the proposed method by experiments. We introduce a diffractive optical element (DOE) designed by 4level-PRPS [11, 17], which is set to the x-y translation stage in the optical system of holographic 3D printer, and record the HS by the proposed method. We evaluate the granularity noise contrast at infinity and the energy of high frequency noise at hologram plane in the same way as section 3.2 and 3.3 respectively. As the DOE used in this experiment is designed for the wavelength of 633nm, we used He-Ne laser and the reconstructed image is evaluated by red light.
At first, we describe the experimental result of granularity noise at infinity qualitatively. We can see that the reconstructed light distribution of HS recorded with the DOE shown in Fig. 12(b) becomes a periodic dot pattern likewise the simulation shown in Fig. 12(a). Then, we can see that recorded by 4 times multiple exposures with shifted DOE shown in Fig. 12(e), the dot pattern are superposed incoherently to fill the gap between each dots likewise the simulation shown in Fig. 12(d). The effect is not very apparent, but it can be confirmed that the intensity in the gaps becomes higher in (e) than (b). The reason why the gaps can be still observed is the difference between diffraction efficiencies of four holograms recorded by multiple exposures with shifted DOE. It is required to adjust the exposure balance of multiple exposures to improve the effect of the proposed method. But, we can confirm that a HS recorded with the proposed method realizes a better visual effect of the reconstructed image at infinity than single or multiple exposures with moving diffuser shown in Fig. 12(c) or (f).
An upper line of Table 1 shows the evaluation results of the granularity noise contrast. The contrast of the proposed method is slightly smaller than the multiple exposures with moving diffuser (uncorrelated phases). Here, it is to be noted that the periodic structure shown in Fig. 12(a, b) is reflected in the granularity noise contrast, while the structure is not so obstructive for visual observation. Although the simulation of our proposed method with an ideal condition indicates that the reduction factor of the granularity noise contrast is higher than , it is unrealized in this experiment because of the non-optimal exposure balance in the multiple exposure as mentioned above. Therefore, the optimization of exposing conditions is required for more effective noise reduction.
We also demonstrate the high frequency noise on hologram plane. Figure 13 shows the image focused on hologram plane. This results indicate that the proposed method can suppress the high frequency noise as compared to the single exposure with moving diffuser as shown in Fig. 13(a, b). Moreover, the evaluation of the noise energy is shown in the lower line of Table 1. We can see that the noise in the proposed method is smaller than the single exposure with moving diffuser. From these results, we can confirm the validity of our proposed method using multiple exposures with shifted DOE. Finally, the results of the experiments are summarized in Fig. 14 .
5. Discussions
In the proposed method, there are some issues for the optical implementation. The digital diffuser can be implemented by DOE fabricated on a glass plate or a phase only SLM. In the former case, which is used in the experiment of previous section, as it is necessary to move the DOE mechanically, it requires longer moving time and introduces vibration to the recording system. In addition, when producing the full-color HS, three DOE for RGB and complicated optical system are needed. In contrast, the latter case, there are not problems described above. However, in the case of a phase only SLM such as PAL-SLM [23], a pixel crosstalk of phase modulation is concerned as shown in Fig. 15 . In this case, the pixel crosstalk between 3π/2 and 0 phase modulation in 4level-PRPS is the critical problem. Therefore we consider that it is necessary for achieving the proposed method more effectively to study combining the proposed method with the techniques to avoid the pixel crosstalk such as [24], or study another type of phase only SLMs such as Liquid Crystal on Silicon (LCoS) SLM, which is known as a smaller crosstalk. Moreover, we have to consider the effect of a phase modulation by LCD used for amplitude modulation, although LCD is not used in the experiment of previous section.
The evaluation of human visual perception of a speckle noise is another issue for future investigation. Considering a human perception is necessary for the granularity noise evaluations of the HS in addition to the contrast and the noise energy described in section 3 since a relation between human perception and these evaluation values is not understood. It has been already studied for laser projection systems [25]. In addition, the appearance of noise depends on the focus of the observer in the case of 3D display.
6. Conclusions
We discuss mainly two methods for the reduction of a granularity noise in holographic 3D printer. First we evaluated the moving diffuser method and found that this method is effective to reduce the granularity noise behind the reconstructed image, although the problem of the high-frequency noise at the hologram plane appears. Second we proposed a new method using multiple exposures to solve this problem. This approach is shown to be effective by the numerical simulation and the experiment.
Acknowledgments
The authors acknowledge Toppan Printing Co., Ltd for their supports on the implementation of holographic 3D printer system.
References and Links
1. M. Yamaguchi, N. Ohyama, and T. Honda, “Holographic three-dimensional printer: new method,” Appl. Opt. 31(2), 217–222 (1992). [CrossRef] [PubMed]
2. M. A. Klug, M. W. Halle, M. E. Lucente, and W. J. Plesniak, “Compact prototype one-step Ultragram printer,” Proc. SPIE 1914, 15–24 (1993). [CrossRef]
3. S. Maruyama, Y. Ono, and M. Yamaguchi, “High-density recording of full-color full-parallax holographic stereogram,” Proc. SPIE 6912, 69120N, 69120N-10 (2008). [CrossRef]
4. L. H. Lin and H. L. Beauchamp, “Write-read-erase in situ optical memory using thermoplastic holograms,” Appl. Opt. 9(9), 2088–2092 (1970). [CrossRef] [PubMed]
5. C. B. Burckhardt, “Use of a random phase mask for the recording of Fourier transform holograms of Data Masks,” Appl. Opt. 9(3), 695–700 (1970). [CrossRef] [PubMed]
6. Y. Takeda, Y. Oshida, and Y. Miyamura, “Random phase shifters for Fourier transformed holograms,” Appl. Opt. 11(4), 818–822 (1972). [CrossRef] [PubMed]
7. C. N. Kurtz, H. O. Hoadley, and J. J. DePalma, “Design and synthesis of random phase diffusers,” J. Opt. Soc. Am. 63(9), 1080–1092 (1973). [CrossRef]
8. W. J. Dallas, “Deterministic diffusers for holography,” Appl. Opt. 12(6), 1179–1187 (1973). [CrossRef] [PubMed]
9. S. Yonezawa, “A deterministic phase shifter for holographic memory devices,” Opt. Commun. 19(3), 370–373 (1976). [CrossRef]
10. Y. Torii, “Synthesis of deterministic phase codes for phase shifter in holography,” Opt. Commun. 24(2), 175–180 (1978). [CrossRef]
11. Y. Nakayama and M. Kato, “Diffuser with pseudorandom phase sequence,” J. Opt. Soc. Am. 69(10), 1367–1372 (1979). [CrossRef]
12. A. Iwamoto, “Artificial diffuser for Fourier transform hologram recording,” Appl. Opt. 19(2), 215–221 (1980). [CrossRef] [PubMed]
13. F. Wyrowski and O. Bryngdahl, “Iterative Fourier-transform algorithm applied to computer holography,” J. Opt. Soc. Am. A 5(7), 1058–1065 (1988). [CrossRef]
14. R. Bräuer, F. Wyrowski, and O. Bryngdahl, “Diffusers in digital holography,” J. Opt. Soc. Am. A 8(3), 572–578 (1991). [CrossRef]
15. N. Kihara, A. Shirakura, and S. Baba, “Method and apparatus for creating holographic stereogram,” U.S. Patent 5,949,559 (1999).
16. J. Yang, L. M. Bernardo, and Y. S. Bae, “Improving holographic data storage by use of an optimized phase mask,” Appl. Opt. 38(26), 5641–5645 (1999). [CrossRef] [PubMed]
17. M. Yamaguchi, H. Endoh, T. Honda, and N. Ohyama, “High-quality recording of a full-parallax holographic sterogram with a digital diffuser,” Opt. Lett. 19(2), 135–137 (1994). [CrossRef] [PubMed]
18. P. St.-Hilaire, “Phase profiles for holographic stereograms,” Opt. Eng. 34(1), 83–89 (1995). [CrossRef]
19. L. E. Helseth and I. Singstad, “Diffusers for holographic stereography,” Opt. Commun. 193(1-6), 81–86 (2001). [CrossRef]
20. J. W. Goodman, Speckle Phenomena in Optics: Theory and Applications (Roberts and Company, Englewood, 2007).
21. D. C. Ong, S. Solanki, X. Liang, and X. Xu, “Analysis of laser speckle severity, granularity, and anisotropy using the power spectral density in polarcoordinate representation,” Opt. Eng. 51(5), 054301 (2012). [CrossRef]
22. W. F. Hsu and C. F. Yeh, “Speckle suppression in holographic projection displays using temporal integration of speckle images from diffractive optical elements,” Appl. Opt. 50(34), H50–H55 (2011). [CrossRef] [PubMed]
23. Y. Igasaki, F. Li, N. Yoshida, H. Toyoda, T. Inoue, N. Mukohzaka, Y. Kobayashi, and T. Hara, “High efficiency electrically-addressable phase-only spatial light modulator,” Opt. Rev. 6(4), 339–344 (1999). [CrossRef]
24. M. Persson, D. Engström, and M. Goksör, “Reducing the effect of pixel crosstalk in phase only spatial light modulators,” Opt. Express 20(20), 22334–22343 (2012). [CrossRef] [PubMed]
25. S. Roelandt, Y. Meuret, G. Craggs, G. Verschaffelt, P. Janssens, and H. Thienpont, “Standardized speckle measurement method matched to human speckle perception in laser projection systems,” Opt. Express 20(8), 8770–8783 (2012). [CrossRef] [PubMed]