## Abstract

A technique is presented for realistic rendering in polygon-based computer-generated holograms (CGHs). In this technique, the spatial spectrum of the reflected light is modified to imitate specular reflection. The spectral envelopes of the reflected light are fitted to a spectral shape based on the Phong reflection model used in computer graphics. The technique features fast computation of the field of objects, composed of many specular polygons, and is applicable to creating high-definition CGHs with several billions of pixels. An actual high-definition CGH is created using the proposed technique and is demonstrated for verification of the optical reconstruction of specular surfaces.

©2011 Optical Society of America

## 1. Introduction

Computer-generated holograms (CGHs) reconstruct the light of a three-dimensional (3D) scene, unlike conventional displays, which provide only binocular disparity. CGHs are thus an important candidate for future 3D display technology. However, CGH technology suffers from the twin problems of computational and display limitations. Extremely high display resolution is required to display fine 3D images using CGHs. More than one billion pixels must be displayed with a physical resolution of less than $1\text{\hspace{0.17em}}\mathrm{\mu m}$ to create fine 3D images as in classical holography. Electrical devices are unable to meet these requirements at this time, although efforts are continuing toward the realization of true holographic 3D displays. However, brilliant 3D still pictures have recently been realized using CGH technology [1–5]. These still CGHs, fabricated using laser lithography, reconstruct spatial 3D images of occluded 3D scenes in full parallax, which is comparable with the images in classical holography. Because the reconstructed images give almost all of the depth cues, viewers experience a strong sensation of depth that has never been realized using conventional 3D systems.

The other serious problem with CGHs is the long computation time required to compute the full-parallax wave field emitted from occluded 3D scenes. Although CGHs have a long history, few techniques have been proposed for computing or estimation of the light from virtual objects, whose shape and properties are provided by numerical models. The most popular technique at present is the point-based method [6,7]. In this method, an object is assumed to be covered by many point light sources, and spherical waves emitted from these point sources are computed and superposed in the hologram plane. This method is easy to implement but is very time consuming for full-parallax CGHs because point-based methods need gigantic numbers of point sources to create the full 3D surface of the object. Although many techniques for acceleration of this method have been proposed [8–13], it is not easy to use point-based methods to create high-definition full-parallax CGHs of occluded 3D scenes. The other main category used in CGHs is the multiviewpoint projection technique. In this technique, the object fields are yielded by numerous projection images of the object taken from different viewpoints. This technique is applicable to both real scenes [14] and virtual scenes [15–17]. Layered computation models that slice the object may also form a small category among these methods [18,19].

To create extremely high-definition CGHs by laser lithography [1], a polygon-based method is used to compute the object field of the occluded 3D scene [20]. This type of technique also forms a category for computation of CGHs [21–25]. In this method, the object is considered to be composed of small planar surface light sources that have polygonal shapes, and the wave fields emitted by these polygonal sources are calculated and are superposed in the hologram plane. This method speeds up the computation of CGHs considerably because the number of polygons required to form the surface is much smaller than the number of point sources used in the point-based method. The high-definition CGHs created using the polygon-based method can reconstruct fine 3D images and are comparable with classical holograms.

One issue with the polygon-based method as well as with point-based methods is that it cannot reconstruct the large variety of realistic surfaces that can be reconstructed in modern computer graphics (CG). The CGHs created using the method in [20] only reconstruct diffuse surfaces. Thus, the viewers of the hologram do not get any indication of the materials of the surfaces in the optical reconstruction. The theory for realistic rendering of CGHs has been discussed in the literature [26]. This theory is based on a generic model but eventually computes the object fields using a point-based method and does not present any concrete procedure for rendering of realistic surfaces. Two techniques have been proposed for rendering of specular surfaces in the polygon-based method [24,25]. In the former technique, based on a microfacets model, however, it has not been verified whether the specular surfaces are reconstructed in practice. The latter technique uses an atomic force microscope to measure the roughness of real metal surfaces. However, the wave field of the reflected light is computed by using the finite-difference time-domain (FDTD) method, which is an accurate simulation technique for electromagnetic fields, but consumes an enormous amount of computer resources. Therefore, only a small fragment of the possible surfaces can be created by this technique. Computing high-definition CGHs using this method is likely to be impossible. Several studies also propose methods based on the Phong reflection model [27] and the Cook-Torrance reflection model [28]. The former is conceptually similar to the technique proposed in this paper. However, the formulation is incomplete and insufficient to create actual CGHs of 3D objects. The latter method using a special propagation kernel (impulse response) is also too time consuming to create high-definition CGHs because the propagation kernel is dependent on the reflection direction of each individual polygon.

In this paper, we propose a technique for rendering of specular surfaces in the polygon-based method. This technique, based on the Phong reflection model, features sufficiently fast computation to create polygon-based high-definition CGHs. An actual high-definition CGH, fabricated using laser lithography, is demonstrated for verification of the proposed technique.

## 2. Rendering of Specular Surfaces

In the polygon-based method, all polygons have their own local coordinates [20], as shown in Fig. 1. The local coordinates of the polygon $n$ are given by $({x}_{n},{y}_{n},{z}_{n})$, where the ${z}_{n}$ axis is always perpendicular to the polygon surface. Because we concentrate on a given single polygon here, the suffix $n$ is largely omitted in the rest of this section.

#### A. Surface Function

The theoretical model of the polygonal surface light source is a slanted aperture irradiated by a plane wave behind the aperture, as shown in Fig. 2(a) [20,29]. The aperture has the same shape and slant as the polygon. Also, a diffuser plate is mounted in the aperture because the aperture corresponding to the polygon is commonly too large to diffuse the irradiated light sufficiently. The aperture provided with the diffuser is expressed using a complex function defined in the $(x,y,0)$ plane of the local coordinates. This complex function is referred to as a surface function. The common form of the surface function is given by

where $a(x,y)$ is the amplitude distribution that gives the shape, texture, and brightness of the polygon. The phase distribution $\varphi (x,y)$ plays the role of the diffuser that spreads the light over the hologram. Thus, the phase distribution is important for rendering of the specular surface because the diffusiveness and direction of the emitted light is determined by $\varphi (x,y)$.Figure 3(a) shows an example of the surface function for a conventional diffuse surface. Figure 3(b) also shows the Fourier spectrum given by

where the symbol $\mathcal{F}\{\xb7\}$ stands for a Fourier transform and $u$ and $v$ are spatial frequencies with respect to $x$ and $y$ of the local coordinates, respectively. In our polygon-based method, the spectrum is shifted to force the direction of the emitted light into the $Z$ axis of the global coordinates and to calculate the wave field in the plane parallel to the hologram [20]. This procedure is called spectral remapping. Although light travels along the global $Z$ axis after spectral remapping, as shown in Fig. 2(b), the light is emitted to the normal direction of the aperture before the remapping. The following formulation and discussion are thus given in the local coordinates before the spectral remapping procedure.#### B. Spectrum of Diffuse and Specular Reflection

Figure 4 schematically illustrates two types of surface reflection: diffuse and specular reflection. The spatial spectra of these two types of reflection are also schematically depicted in Fig. 5. Because the spectrum gives the far-field pattern of the light, diffuse reflection has a broadband spectrum. A quasi-random pattern is thus provided to the phase distribution $\varphi (x,y)$ in rendering of diffuse surfaces so that the spectrum has a broad band as in Fig. 3(b).

In specular reflection, the energy of the reflected light is concentrated around the reflection direction, which is not usually coincident with the normal of the polygon. The spectrum is therefore narrow when compared with diffuse reflection and is shifted from the origin, as shown in Fig. 5. When the reflection angle is $\theta $ in the $(x,0,z)$ plane of the local coordinates, the shift magnitude is obtained from the far-field diffraction as follows:

where $\lambda $ is the wavelength of the light. The frequency shift is found easily using the far-field consideration, whereas the shape of the spectrum cannot be determined without a reflection model.#### C. Spectral Envelope Based on Phong Reflection Model

The fact that specular surfaces have a limited diffusiveness leads to narrowing of the bandwidth of the reflected light. Here the reflected light is represented by the surface function in the polygon-based method. This means that the spectrum of the surface function must be band limited for creation of specular surfaces. We use the Phong model for specular reflection [30] to determine the shape of the spectrum of the phase distribution $\varphi (x,y)$. The Phong model, illustrated in Fig. 6(a), is the most popular model for rendering of specular surfaces in CG. In the Phong model, the relative brightness of the specular light that a viewer observed in the viewing direction $\mathbf{V}$ is given b:

where $\alpha $ is a shininess constant. The vector $\mathbf{R}={R}_{x}\mathbf{x}+{R}_{y}\mathbf{y}+{R}_{z}\mathbf{z}$ gives the direction of regular reflection, where $\mathbf{x}$, $\mathbf{y}$, and $\mathbf{z}$ are the unit vectors in $x$, $y$, and $z$ of the local coordinates. In this model, a larger shininess constant value provides higher specularity, and we note that the brightness is zero if the angle of $\mathbf{R}$ and $\mathbf{V}$ is more than $90\xb0$ ($\mathbf{R}\xb7\mathbf{V}<0$). The brightness is shown as a function of the viewing angle $\phi $ in Fig. 6(b).In the far field, the light traveling in the viewing direction can be regarded as a plane wave. We therefore propose that the viewing direction can be interpreted as a unit wave vector as follows:

where $\mathbf{k}$ is the wave vector given in the local coordinates and $k=|\mathbf{k}|=2\pi /\lambda $ is the wavenumber. Also, the wave vector can be written using the spatial frequencies as follows: where $u$ and $v$ are again the Fourier frequencies but are limited in ${u}^{2}+{v}^{2}\le 1/{\lambda}^{2}$. The frequency $w$ with respect to $z$ is not independent of $u$ and $v$, and is given by By substituting Eqs. (6) and (7) into Eq. (5), the view vector is rewritten asTo create the specular surfaces using the polygon-based method, the phase factor $\mathrm{exp}[i\varphi (x,y)]$ must be modified so that its spectral envelope is fitted to ${I}_{1}(u,v;\mathbf{R}{)}^{1/2}$ because the brightness of the surface corresponds to the intensity of the reflection field. The modified spectrum of the diffuser is given by

Figure 8 shows an example of the modified spectrum ${G}_{1}(u,v;\mathbf{R})$, the spectral envelope ${I}_{1}(u,v;\mathbf{R})$, and the spectrum of the original diffuser $\mathrm{\Phi}(u,v)$. Because $|{\mathcal{F}}^{-1}\{{G}_{1}(u,v;\mathbf{R})\}|\not\equiv 1$, we define the modified phase distribution of the diffuser as follows:#### D. Rendering Objects Composed of Specular Surfaces

Each field of the specular polygons is created by modification of the spectral envelope. However, computation using Eq. (14) is time consuming when calculating the whole wave field of objects because each of the polygons comprising the object has its own reflection vector of ${\mathbf{R}}_{n}$ as shown in Fig. 9. The phase distribution must be generated for each polygon if using ${\varphi}_{1}(u,v;{\mathbf{R}}_{n})$.

To reduce the computational effort, the light that is emitted by the specular polygon and that travels in the normal direction should be calculated as a first step. In this case, the surface function based on the Phong model is given by

The surface function emitting the light in the direction of $\mathbf{R}$ is given by where $\mathbf{r}=x\mathbf{x}+y\mathbf{y}+z\mathbf{z}$ is a position vector and $\mathrm{exp}[ik\mathbf{R}\xb7\mathbf{r}]=\mathrm{exp}[ik({R}_{x}x+{R}_{y}y)]$ is the plane wave traveling in the $\mathbf{R}$ direction. In Fourier space, the spectrum of the modified surface function is written asBy using the same procedure as Eqs. (16) and (17), the spectral envelope of ${H}_{2}(u,v;\mathbf{R})$ is given by

#### E. Procedure for Rendering Surfaces

The final surface function is basically given by the weighted sum of the surface functions for diffuse reflection and specular reflection, as follows:

where ${h}_{d}(x,y)$ and ${h}_{s}(x,y)$ are the surface functions for diffuse and specular reflection, respectively. The coefficients ${K}_{d}$ and ${K}_{s}$ are the weights of these functions. However, in the proposed method, the specular surface function calculated by Eq. (17) is given in Fourier space instead of real space. Therefore, the weighted sum is carried out in Fourier space as follows: where ${H}_{d}(u,v)$ is the spectrum of the surface function for diffuse reflection. Figure 10 shows an example of generation of this surface function. The specular surface function $h(x,y;\mathbf{z})$ with the phase distribution ${\varphi}_{1}(x,y;\mathbf{R})$ of Eq. (15) is Fourier transformed and then shifted as in Fig. 10(a). Here the amplitude distribution for the specular reflection ${a}_{s}(x,y)$ is a binary function and gives only the shape of the polygon because the shading of the object is provided by the diffuse surface. The diffuse surface function is also Fourier transformed and superposed into the spectrum of the specular surface function.## 3. Creation of High-Definition CGH of Specular Object

We created a high-definition CGH, named “The Metal Venus I” after the first polygon-based high-definition CGH, “The Venus” [1], that reconstructs the object with diffusive surfaces. The 3D scene of the CGH, shown in Fig. 11, is almost the same as that of The Venus. The statue of the Venus is $5.7\mathrm{cm}$ in height and is composed of 1396 polygons. The parameters used to compute the CGH are summarized in Table 1. Note that the size of the sampling window for the specular surface function is the same as that for the diffuse surface function, but the sampling interval is smaller than that used for the diffuse function. In the Fourier space, this leads to extension of the sampling window. Because the specular spectrum is shifted prior to the weighted sum, if the sampling windows are not sufficiently large, the spectrum may not overlap with that of the diffuse surface. This is why the sampling interval for the specular surface function is set to a value smaller than that for the diffuse surface.

Computation of the CGH was executed using a PC with two Xeon X5680 ($3.33\text{\hspace{0.17em}}\mathrm{GHz}$) CPUs and $144\text{\hspace{0.17em}}\mathrm{Gbytes}$ of memory. The total number of CPU cores is 12. The total computation time was approximately $3.6\text{\hspace{0.17em}}\mathrm{h}$. The itemized computation times are shown in Fig. 12. The longest part of this time was consumed by computation of the field of the Venus statue. This took 2.6 times longer to compute than the original Venus, which was rendered with only diffusive surfaces. The increased computation time is most likely caused by the separate calculations for specular and diffuse light in the proposed technique.

The optical reconstruction of The Metal Venus I is shown in Figs. 13(a) and 14. The Venus is shown in Fig. 13(b) for comparison with The Metal Venus I. It is shown that a metallic surface has been reconstructed for The Metal Venus, and the surface brightness clearly varies with respect to the viewpoint.

## 4. Discussion

In Eq. (20), the role of weights ${K}_{d}$ and ${K}_{s}$ are different from those in CG. These coefficients represent the brightness ratio in CG, but ${H}_{s}(x,y)$ and ${H}_{d}(x,y)$ represent the amplitudes of the electric field of light in this case. The intensity and brightness are proportional to the squares of these functions. Also, the surface brightness in polygon-based CGHs depends on the bandwidth of the phase distribution of the surface function used. For example, if ${K}_{d}={K}_{s}$, the diffuse surface is reconstructed to be considerably darker than the specular surface. The specular surface emits light in a smaller solid angle than that of the diffuse surface, and thus the brightness of the specular surface is higher than that of the diffuse surface. In this study, these weights are determined by trial and error using a simulated reconstruction technique.

The shininess constant $\alpha $ in the proposed method is inherited from the Phong model. This constant plays a similar role in the Phong model and thus represents the sharpness or directionality of the reflection light. However, the distribution of the reflection light in CGHs is different from that in CG if rendered with the same shininess constant because the spectral shape of ${I}_{2}(u,v;\mathbf{R})$ is not identical with ${I}_{1}(u,v;\mathbf{R})$ of the Phong model, especially in large reflection angles, as shown in Fig. 7.

The weight of the ambient light is not explicitly indicated in Eq. (20) because the surface function for ambient light is not used in the polygon-based method. However, the ambient light ratio is involved in the diffuse surface function. In the Metal Venus I, the ambient light has 0.1 times the brightness of the diffuse polygon that is perpendicular to the incident illumination light.

## 5. Conclusion

A new method for rendering of specular surfaces is proposed for creation of realistic CGHs. The Phong reflection model is used to determine the spectral shape of the reflected light of the specular surfaces. The spectrum of the surface functions used in the polygon-based method is modified so that the envelope fits the spectral shape. In the proposed method, the reflection direction is changed by shifting the spectrum, rather than generating individual surface functions fitted to each polygon, to accelerate the computation. A high-definition CGH named The Metal Venus I was created using the proposed method. Optical reconstruction of The Metal Venus I shows a metallic appearance, and the brightness changes depending on the viewpoint, as intended.

This work was supported by the JSPS.KAKENHI (21500114) and the Kansai University research grants, Grant-in-Aid for Encouragement of Scientists, 2011–2012. The mesh data for the Venus object are provided courtesy of INRIA by the AIM@SHAPE Shape Repository.

## References

**1. **K. Matsushima and S. Nakahara, “Extremely high-definition full-parallax computer-generated hologram created by the polygon-based method,” Appl. Opt. **48**, H54–H63 (2009). [CrossRef]

**2. **K. Matsushima and S. Nakahara, “High-definition full-parallax CGHs created by using the polygon-based method and the shifted angular spectrum method,” Proc. SPIE **7619**, 761913 (2010). [CrossRef]

**3. **K. Matsushima, M. Nakamura, and S. Nakahara, “Novel techniques introduced into polygon-based high-definition CGHs,” in Topical Meeting on Digital Holography and Three-Dimensional Imaging, OSA Technical Digest (CD) (Optical Society of America, 2010), paper JMA10.

**4. **K. Matsusima, M. Nakamura, I. Kanaya, and S. Nakahara, “Computational holography: real 3-D by fast wave-field rendering in ultra high resolution,” in Proceedings of SIGGRAPH Posters 2010 (ACM, 2010), http://doi.acm.org/10.1145/1836845.1836974.

**5. **H. Nishi, K. Higashi, Y. Arima, K. Matsushima, and S. Nakahara, “New techniques for wave-field rendering of polygon-based high-definition CGHs,” Proc. SPIE **7957**, 79571A (2011). [CrossRef]

**6. **J. P. Waters, “Holographic image synthesis utilizing theoretical methods,” Appl. Phys. Lett. **9**, 405–407 (1966). [CrossRef]

**7. **A. D. Stein, Z. Wang, and J. J. S. Leigh, “Computer-generated holograms: a simplified ray-tracing approach,” Comput. Phys. **6**, 389–392 (1992). [CrossRef]

**8. **M. Lucente, “Interactive computation of holograms using a look-up table,” J. Electron. Imaging **2**, 28–34 (1993). [CrossRef]

**9. **A. Ritter, J. Böttger, O. Deussen, M. König, and T. Strothotte, “Hardware-based rendering of full-parallax synthetic holograms,” Appl. Opt. **38**, 1364–1369 (1999). [CrossRef]

**10. **K. Matsushima and M. Takai, “Recurrence formulas for fast creation of synthetic three-dimensional holograms,” Appl. Opt. **39**, 6587–6594 (2000). [CrossRef]

**11. **H. Yoshikawa, S. Iwase, and T. Oneda, “Fast computation of Fresnel holograms employing difference,” Proc. SPIE **3956**, 48–55 (2000). [CrossRef]

**12. **N. Masuda, T. Ito, T. Tanaka, A. Shiraki, and T. Sugie, “Computer generated holography using a graphics processing unit,” Opt. Express **14**, 603–608 (2006). [CrossRef]

**13. **Y. Ichihashi, H. Nakayama, T. Ito, N. Masuda, T. Shimobaba, A. Shiraki, and T. Sugie, “HORN-6 special-purpose clustered computing system for electroholography,” Opt. Express **17**, 13895–13903 (2009). [CrossRef]

**14. **N. T. Shaked, B. Katz, and J. Rosen, “Review of three-dimensional holographic imaging by multiple-viewpoint-projection based methods,” Appl. Opt. **48**, H120–H136 (2009). [CrossRef]

**15. **T. Yatagai, “Stereoscopic approach to 3-D display using computer-generated holograms,” Appl. Opt. **15**, 2722–2729 (1976). [CrossRef]

**16. **H. Kang, T. Fujii, T. Yamaguchi, and H. Yoshikawa, “Compensated phase-added stereogram for real-time holographic display,” Opt. Eng. **46**, 095802 (2007). [CrossRef]

**17. **K. Wakunami and M. Yamaguchi, “Calculation for computer generated hologram using ray-sampling plane,” Opt. Express **19**, 9086–9101 (2011). [CrossRef]

**18. **A. W. Lohmann, “Three-dimensional properties of wave-fields,” Optik **51**, 105–117 (1978).

**19. **M. Bayraktar and M. Özcan, “Method to calculate the far field of three-dimensional objects for computer-generated holography,” Appl. Opt. **49**, 4647–4654 (2010). [CrossRef]

**20. **K. Matsushima, “Computer-generated holograms for three-dimensional surface objects with shade and texture,” Appl. Opt. **44**, 4607–4614 (2005). [CrossRef]

**21. **L. Ahrenberg, P. Benzie, M. Magnor, and J. Watson, “Computer generated holograms from three dimensional meshes using an analytic light transport model,” Appl. Opt. **47**, 1567–1574 (2008). [CrossRef]

**22. **H. Kim, J. Hahn, and B. Lee, “Mathematical modeling of triangle-mesh-modeled three-dimensional surface objects for digital holography,” Appl. Opt. **47**, D117–D127(2008). [CrossRef]

**23. **Y.-Z. Liu, J.-W. Dong, Y.-Y. Pu, B.-C. Chen, H.-X. He, and H.-Z. Wang, “High-speed full analytical holographic computations for true-life scenes,” Opt. Express **18**, 3345–3351(2010). [CrossRef]

**24. **K. Yamaguchi and Y. Sakamoto, “Computer generated hologram with characteristics of reflection: reflectance distributions and reflected images,” Appl. Opt. **48**, H203–H211 (2009). [CrossRef]

**25. **T. Ichikawa, Y. Sakamoto, A. Subagyo, and K. Sueoka, “A method of calculating reflectance distributions for CGH with FDTD using the structure of actual surfaces,” Proc. SPIE **7957**, 795707 (2011). [CrossRef]

**26. **M. Janda, I. Hanák, and L. Onural, “Hologram synthesis for photorealistic reconstruction,” J. Opt. Soc. Am. A **25**, 3083–3096 (2008). [CrossRef]

**27. **Y. Sakamoto and Y. Yamashita, “An algorithm for object-light calculation considering reflectance distribution for computer-generated holograms,” J. Inst. Image Inf. Television Eng. **56**, 611–616 (2002), in Japanese. [CrossRef]

**28. **Y. Sakamoto and A. Tsuruno, “A representation method for object surface glossiness in computer-generated hologram,” IEICE Trans. Inf. Syst. 2 **J88-D-2**, 2046–2053 (2005), in Japanese.

**29. **K. Matsushima, H. Nishi, and S. Nakahara are preparing a manuscript to be called “Simple wave-field rendering for photorealistic reconstruction in polygon-based high-definition computer holography.”

**30. **B. T. Phong, “Illumination for computer generated pictures,” Commun. ACM **18**, 311–317 (1975). [CrossRef]