Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Stereoscopic deflectometry with a curved screen

Open Access Open Access

Abstract

Deflectometry has been widely used in topography measurement of specular surface. In deflectometry with a curved screen, the range of the gradient and height field of the measured specular surface can be effectively expanded compared to deflectometry with a plane screen. As stereo deflectometry measures gradient with high accuracy, the specular surface is reconstructed by integrating the gradient. In this paper, a stereo deflectometry with a curved screen is proposed in the aspect of system calibration and measuring principle. A pair of cameras and deflectometric system are calibrated simultaneously to obtain the camera parameters and relationship between two cameras and the curved screen. Then, pairs of rectified fringe patterns are demodulated to obtain two pairs of rectified absolute phase maps and homologous points are searched along epipolar line with the principle of the same normal direction on specular surface. Finally, simulated and actual experiments are carried out and the results show high accuracy and stability.

© 2022 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement

1. Introduction

Components with specular surface are widely used in aerospace, automobile, optics system and artificial intelligence. Along with interferometer [1,2] and Hartmann test [3], phase measuring deflectometry (PMD) can efficiently measure gradient and height of specular surface under test (SuT) because of its advantages of full-field data acquisition, non-contact operation, automatic data processing, high accurate data, and large dynamic range [4,5].

Based on the principle of specular surface reconstruction, PMD can be derived into classical PMD [68], light-tracking based PMD [9,10], model PMD(MPMD) [11,12], differential-geometry based PMD [1316], direct PMD(DPMD) [17,18], et.al. Based on the number of imaging device (normally camera) in PMD systems, PMD can be derived into monoscopic PMD (mono-PMD) and stereoscopic PMD (stereo-PMD).

A PMD system usually contains a liquid crystal display (LCD), a computer and a camera in mono-PMD or two cameras in stereo-PMD, as illustrated in Fig. 1. Straight fringe patterns are generated in software and displayed on the LCD. The camera captures the distorted fringe patterns modulated by the measured surface. Phase information is demodulated from the captured fringe patterns to reconstruct three-dimensional (3-D) shape. Conventional PMD reconstructs specular surface by integration of gradient computed from the distorted patterns. In mono-PMD based on light tracking, there are usually a moving LCD [9,10] or two LCD matching a beam splitter [17,18] to orient light and furtherly reconstruct SuT. In mono-PMD based on differential geometry, instead of moving the LCD or adding a LCD, specular surface can be reconstructed by differential property of specular surface. DPMD directly formulates variation of phase and height, instead of gradient of surface with integration, so it is convenient to reconstruct discontinues or isolated specular surface [17,18]. In stereo-PMD, with the principle of consistence of a point’s normal direction on SuT [19], the gradient can be computed. The specular surface can be reconstructed by integration of gradient. In mono-PMD and stereo-PMD, by modeling the specular surface, MPMD solves model parameters and system parameters by iteration.

 figure: Fig. 1.

Fig. 1. Deflectometry system. (a). mono-PMD, (b). stereo-PMD.

Download Full Size | PDF

The calibration of stereo-PMD builds up the relationship among the screen and a pair of cameras. Recently, a calibration method for stereo deflectometric system and cameras through an iterative optimization is studied [20]. To improve the accuracy of calibration, speckle patterns are employed in the calibration method for stereo deflectometry [21]. An on-machine calibration method for stereo deflectometric system is proposed which reduces the number of intermediate parameters and improves the accuracy of calibration [22].

With the gradient computed by stereo-PMD, specular surface can be reconstructed. Traditionally, the zonal reconstruction is carried out along rectangular mesh [23]. However, the obtained gradient data usually locate on a quadrilateral geometry in the camera’s coordinate, instead of a rectangular mesh. To solve this problem, reconstruction methods on the quadrilateral geometry are proposed, such as high-order least-squares method [24], radial basis functions method [25] and the method in general form of zonal reconstruction [26], et. al.

When a plane screen employed in PMD, because of screen’s shape and size, some part of SuT will reflect scene outside the plane screen, resulting that SuT can’t be measured in single measurement. As a large-curvature specular surface is placed in front of a curved screen, a curved screen can effectively solve this problem because of its distinguishing characteristic. The effect of a curved screen in expanding measurement range of specular surface is discussed elaborately in [27]. Therefore, a curved screen with small size can measure larger specular surface than a plane screen. The measuring principle and the calibration methods of mono-PMD with the curved screen have been studied [27]. With excellent performance of improving the accuracy and the measurable range, a stereo-PMD with a curved screen has been studied in [28].

Different from the stereo-PMD system in [28], this paper proposed a stereo-PMD with a curved screen to measure large-curvature specular surface in single measurement. In calibration of system, this paper calibrates a pair of cameras and system simultaneously by minimizing reprojection error in a procedure of iteration, instead of separated calibration of every camera and the curved screen in [28]. In the principle of measurement, this paper reconstructs SuT by integration of gradient in common field of view of the pair of cameras, instead of registration of point cloud from the pair of cameras in [28]. In the proposed stereo-PMD, combined with solved gradient of SuT, there will be an initial solved 3-D coordinate of SuT. In PMD systems, the solved gradient tends to be more accurate than the solved z component of initial 3-D coordinate. To the extent that with an absolute uncertainty of z component up to 0.1mm, the absolute error of slope is less than 100 arcsec [29]. With the solved gradient and x, y components of the initial 3-D coordinate, SuT can be reconstructed more accurately by integration.

In the following, Section 2 explains the system calibration and measuring principle of the proposed stereo-PMD with a curved screen. In Section 3, the simulated and actual experiments have been performed to verify the proposed stereo-PMD. Section 4 gives conclusion and future directions.

2. Principle and calibration

This section presents the principle and calibration of the stereo-PMD with a curved screen.

2.1 Stereo-PMD with a curved screen

A diagram of the proposed stereo-PMD system is shown in Fig. 2. It contains two cameras and a curved screen. A pair of cameras are mounted on the top of the curved screen. After calibration of the stereo-PMD system, a SuT is measured. The screen displays phase-shifted [30] horizontal and vertical sinusoidal fringes with fringe numbers N2, N2-1, N2-N selected by the optimum fringe frequency method [31,32]. The displayed fringes are reflected by SuT, and then the distorted fringes are captured by the two cameras. In configuration of the system, SuT and the pair of cameras should be close to the middle of the curved screen in the horizonal direction. With a certain curved screen, the distance between SuT and the curved screen play a major role in extending range of measurement. Thus, on the premise that screen does not shield SuT from the perspective of the pair of cameras, SuT should be as close as possible to the curved screen.

 figure: Fig. 2.

Fig. 2. Diagram of the stereo-PMD.

Download Full Size | PDF

In consideration of efficiency, the recorded fringe patterns are rectified by the results of calibration. The rectified image of a point in measurement field locates on the same row of images pair which will accelerate matching of homologous points. After rectification, the rectified fringe patterns are demodulated to obtain two pairs of absolute phase map in the horizontal and vertical direction. However, specular surface reflects fringe patterns, resulting in different phase values in the pair of cameras.

Every pixel in the pair of cameras corresponds to a position on the screen which can be obtained by interpolation of the absolute phase. In the rectified phase map pairs, homologous points locate on the same row of images. Once a base pixel in camera1 is chosen, searching of the homologous pixel is along the row in camera 2. Along the row, every pixel in camera 2 orients a point by triangulation with the base pixel. If the point is on SuT, the bisectors of light corresponding to camera 1 and 2 are the closest. With this principle, the homologous point of pixel level in camera 2 can be searched. The homologous point in subpixel level can be searched by the interpolated phase value in camera 2. The detailed procedure of searching is illustrated in Fig. 3.

 figure: Fig. 3.

Fig. 3. Diagram of stereo-PMD.

Download Full Size | PDF

With a base point q on camera 1, it captures screen pixel of the reflected light A. After computing difference of bisectors of camera 1 and 2 along base pixel q’s row, p2’s bisector is the closest to q’s corresponding to D2. p1 and p3 corresponding to D1 and D3 are adjacent pixels to p2. B1, B2 and B3 has the same phase value to p1, p2 and p3, respectively. In the searching range between p3 and p1, a subpixel p’s phase value and the corresponding position in screen can be obtained by interpolation among p3, p2 and p1. As bisectors of camera 1 and camera 2 are denoted as n1 and n2 respectively, searching range is decreased by an iteration procedure, as illustrated in Fig. 4. When the distance between p1 and p3 is less than ${{\boldsymbol \varepsilon }_\textrm{p}}$ and the cross product between n1 and n2 is less than ${{\boldsymbol \varepsilon }_\textrm{n}}$, the iteration terminates with solving p = p2. A subpixel p corresponding to D can be obtained with satisfied similarity of bisectors. With triangulation, 3-D coordinate of point D can be obtained. The bisector of $\angle \textrm{ }{\textrm{F}_\textrm{1}}\textrm{DA}$ is normal direction of SuT and the corresponding gradient of point D can be computed.

 figure: Fig. 4.

Fig. 4. Procedure of search p in subpixel level.

Download Full Size | PDF

Although initial 3-D coordinate of SuT is obtained, the gradient is more accurate than the 3-D coordinate. Combining the gradient, x and y components are extracted to reconstruct specular surface by integration. In stereo-PMD system, two cameras merely record the distorted fringe patterns with the screen at a fixed position. However, in mono-PMD with a curved screen [27], a camera needs to record both normal and distorted fringe patterns with different positions of the screen which is one of the main sources of error. Thus, the stereo-PMD tends to be more accurate than a mono-PMD.

2.2 Calibration of stereo-PMD with a curved screen

The calibration of stereo-PMD with the curved screen is to confirm relationship among the pair of cameras and the curved screen. Because it has a changeable radius, the commercial curved screen is reconstructed and a virtual plane with height h and width w is fixed on the curved screen by displaying featured points. By minimizing reprojection error of the featured points to the pair of cameras, the stereo-PMD calibration method solves intrinsic parameters of cameras and extrinsic parameters among the pair of cameras and the virtual plane.

A flat mirror is used to reflect the displayed pattern. Two cameras record n reflected patterns corresponding to n postures of the flat mirror. In every recorded picture, m featured points will be extracted. As the camera 1 is selected as a base camera, transformation of camera 2 to the curved screen and the flat mirror can be computed by a rotation matrix Rstereo and a translation vector Tstereo between camera 1 and camera 2. With the recorded patterns, initial value of Rstereo and Tstereo can be computed by the method in [33]. A point Pleft in camera 1’s coordinate can be transferred to Pright in camera 2’s coordinate by the following equation.

$${{\mathbf P}_{\textrm{right}}} = {R_{\textrm{stereo}}}{{\mathbf P}_{\textrm{left}}} + {{\boldsymbol T}_{\textrm{stereo}}}$$

The diagram of calibration is given in Fig. 5. The initial values of rotation matrix Rvp and translation vector Tvp between camera 1 and the virtual plane can be computed by the method in [34,35]. At a posture i(i = 1, …, n) of the flat mirror, vdi denotes a vector in camera 1’s coordinate from the mirror to the optical center of camera 1 along the mirror’s normal direction nmirror. The coordinate of a featured point Pchecker on the virtual plane is X in the checker coordinate system and its virtual image’s coordinate in camera 1 coordinate system and camera 2 coordinate system are denoted as pleft and pright, respectively. According to relationship of mirror symmetry between a real image and its virtual image, Eq. (2) transforms X to pleft with geometry parameters of the flat mirror Rvp, Tvp and vdi. As initial relationship Rstereo and Tstereo between two cameras have been calibrated, the virtual image of X can be transformed to pright in camera 2’s coordinate by Eq. (3).

$$\begin{array}{l} {{\boldsymbol p}_{\textrm{left}}}({\boldsymbol v}{{\boldsymbol d}_i},{R_{\textrm{vp}}},{{\boldsymbol T}_{\textrm{vp}}}) = \\ ({\boldsymbol I} - \frac{{{\boldsymbol v}{{\boldsymbol d}_i} \cdot {\boldsymbol v}{{\boldsymbol d}_i}^T}}{{{{||{{\boldsymbol v}{{\boldsymbol d}_i}} ||}^2}}}){R_{\textrm{vp}}}\left( \begin{array}{l} 1\\ 0\\ 0 \end{array} \right.\textrm{ }\begin{array}{c} 0\\ { - 1}\\ 0 \end{array}\textrm{ }\left. \begin{array}{l} 0\\ 0\\ 1 \end{array} \right){\boldsymbol X} + ({\boldsymbol I} - \frac{{{\boldsymbol v}{{\boldsymbol d}_i} \cdot {\boldsymbol v}{{\boldsymbol d}_i}^T}}{{{{||{{\boldsymbol v}{{\boldsymbol d}_i}} ||}^2}}}){{\boldsymbol T}_{\textrm{vp}}} - 2{\boldsymbol v}{{\boldsymbol d}_i} \end{array}$$
$${{\boldsymbol p}_{\textrm{right}}}({\boldsymbol v}{{\boldsymbol d}_i},{R_{\textrm{vp}}},{{\boldsymbol T}_{\textrm{vp}}},{R_{\textrm{stereo}}},{{\boldsymbol T}_{\textrm{stereo}}}) = {R_{\textrm{stereo}}} \cdot {{\boldsymbol p}_{\textrm{left}}}({\boldsymbol v}{{\boldsymbol d}_i},{R_{\textrm{vp}}},{{\boldsymbol T}_{\textrm{vp}}}) + {{\boldsymbol T}_{\textrm{stereo}}}$$

 figure: Fig. 5.

Fig. 5. Diagram of stereo-PMD calibration.

Download Full Size | PDF

The nonlinear mathematic model of the left camera and the right camera is marked as ${\Re _{\textrm{left}}}$ and ${\Re _{\textrm{right}}}$, respectively. The intrinsic parameters of the left camera and the right camera are marked as ${A_{\textrm{left}}}$ and ${A_{\textrm{right}}}$, respectively. A cost function is expressed as the following equation to compute distance between the reprojected featured points and the recorded featured point ${{\boldsymbol p}_{_{\textrm{left\_}i{\_}j}}}^{\prime}$, ${{\boldsymbol p}_{_{\textrm{right}\_i{\_}j}}}^{\prime}$. The calibration results are obtained to minimize the cost function (4) by the Levenberg-Marquardt algorithm.

$$\begin{array}{l} f({A_{\textrm{left}}},{A_{\textrm{right}}},{\boldsymbol v}{{\boldsymbol d}_k},{R_{\textrm{vp}}},{{\boldsymbol T}_{\textrm{vp}}},{R_{\textrm{stereo}}},{{\boldsymbol T}_{\textrm{stereo}}}) = \\ \sum\limits_{i = 1}^n {\sum\limits_{j = 1}^m {\{{{{[{{\Re_{\textrm{left}}}\textrm{ (}{{\boldsymbol p}_{\textrm{left\_}i{\_}j}}) - {{\boldsymbol p}_{_{\textrm{left\_}i{\_}j}}}^{\prime}} ]}^2} + {{[{{\Re_{\textrm{right}}}\textrm{ (}{{\boldsymbol p}_{\textrm{right}\_i{\_}j}}) - {{\boldsymbol p}_{_{\textrm{right}\_i{\_}j}}}^{\prime}} ]}^2}} \}} } \end{array}$$

3. Experiment

3.1 Simulated experiment

For testing the proposed stereo-PMD with a curved screen, some simulation experiments have been carried out. A curved screen and a pair of cameras are placed as shown in Fig. 2. A right-handed world coordinate’s xoy plane is fixed on the reference plane. The curved screen is a part of cylinder with a radius of 1000 mm whose axis is parallel to y axis of the world coordinate and passes through (0, 0, 800). The rotation matrix and the translating vector between camera 1 and the reference plane are $\left( \begin{array}{l} \textrm{ 0}\textrm{.9976 0 0}\textrm{.0698}\\ \textrm{ 0}\textrm{.0061 0}\textrm{.9962 - 0}\textrm{.0869}\\ \textrm{ - 0}\textrm{.0695 0}\textrm{.0872 0}\textrm{.9938} \end{array} \right)$ and $\left( \begin{array}{l} \textrm{ }0\\ \textrm{ }0\\ 402.5084 \end{array} \right)$, respectively. A point Pcamera1 in camera 1 can be transferred to Pcamera2 in camera 2 by a rotation matrix $\left( \begin{array}{l} \textrm{ 0}\textrm{.9945 0}\textrm{.0091 - 0}\textrm{.1041}\\ \textrm{ - 0}\textrm{.0127 0}\textrm{.9993 - 0}\textrm{.0342}\\ \textrm{ 0}\textrm{.1037 0}\textrm{.0354 0}\textrm{.9940} \end{array} \right)$ and a translating vector $\left( \begin{array}{l} \textrm{ 41}\textrm{.9135}\\ \textrm{ 13}\textrm{.7796}\\ \textrm{ 13}\textrm{.2478} \end{array} \right)$. The diagram of simulated system in world coordinate is illustrated in Fig. 6. A specular cylinder with a radio of 60 mm has been measured.

 figure: Fig. 6.

Fig. 6. Diagram of simulated system.

Download Full Size | PDF

Noises with different levels were added into the generated fringe patterns by

$${I_{noisy}} = {I_{ideal}} \cdot (1 + i \cdot 0.2/100 \cdot randn)$$
where Inoisy denotes the generated noisy fringe pattern, i is the noise level and i = 0, …, 10, randn is a matrix whose element obeys standard normal distribution.

At different noise levels, the RMS (Root Mean Square) distance between the integrated height and the real height is illustrated in Fig. 7.

 figure: Fig. 7.

Fig. 7. RMS of reconstruction error.

Download Full Size | PDF

The simulated experimental results indicate that the proposed stereo-PMD is of high noise resistance and high reconstruction accuracy.

3.2 Stereo-PMD with a curved screen

3.2.1 Hardware of the stereo-PMD system

The stereo-PMD system consists of a curved screen, two CCD cameras, and a translating stage, as depicted in Fig. 8. The curved screen is fixed on the translating stage. The cameras (XIMEADE XIQ, MQ042CG-CM, Germany) have a resolution of 2048 × 2048 pixels, and use a standard prime lens (AZURE-1620ML5M) of focal length 16 mm. The model of the curved screen is SAMSUNG C24T55* 1000R, with a resolution of 1920*1080, pixel size of 0.272 mm*0.272 mm. The translating stage (DHC, GCD-20Series, Beijing, China) has an accuracy of 1 µm.

 figure: Fig. 8.

Fig. 8. Hardware diagram of stereo-PMD system.

Download Full Size | PDF

3.2.2 System calibration

Calibration of the stereo-PMD is to confirm relationship among the pair of cameras and the curved screen. The curved screen was reconstructed by the method in [27]. Two cameras were placed in front of the curved screen with the displayed fringe patterns. In order to reconstruct the curved screen, pixels on phase maps of two cameras with the same phase value were treated as homologous point. With triangulation between two cameras, the depth of homologous point is computed. Combined with phase value of every homologous point, the point cloud of the curved screen is saved. In order to represent the curved screen, a virtual plane was fixed on the screen by displaying checker pattern at the stage of screen reconstruction, as illustrated in Fig. 9.

 figure: Fig. 9.

Fig. 9. Virtual plane fixed by featured points.

Download Full Size | PDF

After reconstructing the curved screen, a pair of cameras and the curved screen were placed as shown in Fig. 2. A flat mirror was used to reflect the displayed checker pattern. With thirty different postures and positions of the flat mirror, thirty reflected checker patterns were recorded and featured points were extracted. With the recorded checker patterns, two cameras were calibrated to obtain initial calibration results, such as intrinsic parameters and transformation parameters among two cameras and vdi of camera 1. Then, the initial calibration results were substituted into Eq. (4). After iteration, the calibration results are computed by the distribution of reprojection error, as shown in Fig. 10 and the lowest reprojection errors are [0.0638 0.0485] pixels.

 figure: Fig. 10.

Fig. 10. Distribution of reprojection error,○ of camera 1, △ of camera 2.

Download Full Size | PDF

As relationship among the pair of cameras and the curved screen has been calibrated, the model of the curved screen was transferred to camera 1. The calibrated stereo-PMD system in camera 1 is given, as illustrated in Fig. 11, where color bar represents depth of the curved screen in camera 1 coordinate system.

 figure: Fig. 11.

Fig. 11. Calibrated stereo-PMD system.

Download Full Size | PDF

3.2.3 Experiments on a specular surface

In order to evaluate the proposed stereo-PMD method, the system measured a specular cylinder and a specular step.

The specular cylinder is shown in Fig. 12(a). The pair of cameras recorded the reflected fringe patterns, as shown in Fig. 12(b)-(c). After rectification of image pairs, two pairs of absolute phase map in the horizonal and vertical direction were demodulated, as shown in Fig. 12(d)-(e). In order to evaluate the reconstruction by the proposed stereo system, the method reconstructing specular surface in [1315] was treated as a benchmark to a quantitative measurement. Partial differential equations of depth along x and y direction of coordinate of camera 1 were set up. By computing difference of integral depth with different integration sequence in a mask, the depth is final reconstruction which corresponds to the minimum difference of integral depth, as illustrated in Fig. 13(a). The homologous pixel was searched by the method in Section 2.3. Initial reconstruction of specular cylinder by the stereo-PMD system was obtained, as shown in Fig. 13(b). After integration of gradient, the specular cylinder was reconstructed, as shown in Fig. 13(c). The distance of initial reconstruction and integral reconstruction by the stereo-PMD system to the benchmark is shown in Fig. 14(a) and Fig. 14(b), with RMS distance 0.1872 mm and 0.0035 mm respectively. The results indicate that the integral reconstruction is more accurate than the initial reconstruction in the stereo-PMD system with a curved screen.

 figure: Fig. 12.

Fig. 12. Specular cylinder, reflected fringe patterns and rectified phase maps. (a) specular cylinder, (b)-(c) reflected fringe patterns, (d)-(e) rectified phase maps.

Download Full Size | PDF

 figure: Fig. 13.

Fig. 13. Reconstruction of specular cylinder. (a). Reconstruction by method in [1315], (b). initial reconstruction by stereo-PMD, (c). reconstruction by stereo-PMD with integration.

Download Full Size | PDF

 figure: Fig. 14.

Fig. 14. Error of reconstruction to the benchmark. (a). initial reconstruction by stereo-PMD, (b). reconstruction by stereo-PMD with integration.

Download Full Size | PDF

The specular step is shown in Fig. 15(a). The pair of cameras recorded the reflected fringe patterns, as shown in Fig. 15(b)-(c). Two pairs of the rectified absolute phase map in the horizonal and vertical directions were demodulated, as shown in Fig. 15(d)-(e). The homologous pixel was searched by the method in Section 2.3. Initial reconstruction of specular step by the stereo-PMD system was obtained, as shown in Fig. 16(a). After integration of gradient, every isolated surface was reconstructed separately and then transferred a mean distance between initial reconstruction of the surface and integral reconstruction. After transferring every isolated surface, the specular step was reconstructed, as shown in Fig. 16(b).

 figure: Fig. 15.

Fig. 15. Specular step, reflected fringe patterns and rectified phase maps. (a) specular step, (b)-(c) reflected fringe patterns, (d)-(e) rectified phase maps.

Download Full Size | PDF

 figure: Fig. 16.

Fig. 16. Reconstruction of specular step. (a). Initial reconstruction by stereo-PMD, (b). reconstruction by stereo-PMD with integration.

Download Full Size | PDF

The actual distance between steps was measured by a C32-bit ZEISS Calypso coordinate measuring machine. The measured coordinates of every step were fitted to a plane. The distance between the points of the adjacent step and the fitting plane was treated as measured distance. Table 1 shows the comparison between the actual distance and the measured distance.

Tables Icon

Table 1. Actual distance, measurement distance of step and error by three calibration methods (mm)

The results indicate that reconstruction of the specular surface by the proposed stereo-PMD system after integration is more accurate than the initial result. Furthermore, the proposed stereo-PMD with a curved screen reconstructs specular surface with higher accuracy than the mono-PMD system with a curved screen in [27]. Moreover, the RMS distance between integral reconstruction and the fitting plane in a range between 10−3 and 10−5 mm is much lower than the mono-PMD system with a curved screen and initial reconstruction in the proposed stereo-PMD.

4. Conclusion

In this paper, a stereo-PMD with a curved screen has been proposed to measure specular surface. The gradient of specular surface is measured with the principle of normal direction consistence. The light direction corresponding to every camera pixel is oriented by interpolation of the phase value on the screen model. The homologous pixels in subpixel level can be searched by an iteration procedure. Simulated and actual experiments show high accuracy and stability of the proposed stereo-PMD with a curved screen. In the future, further experiments will be carried out to measure more components with specular surface.

Funding

National Natural Science Foundation of China (51675160, 52075147).

Disclosures

The authors declare no conflicts of interest.

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

References

1. J. Wyant, “White light interferometry,” Proc. SPIE 4737, 98–107 (2002). [CrossRef]  

2. X. Jiang, K. Wang, F. Gao, and H. Muhamedsalih, “Fast surface measurement using wavelength scanning interferometry with compensation of environmental noise,” Appl. Opt. 49(15), 2903–2909 (2010). [CrossRef]  

3. P. Su, R. E. Parks, L. Wang, R. P. Angel, and J. H. Burge, “Software configurable optical test system: a computerized reverse Hartmann test,” Appl. Opt. 49(23), 4404–4412 (2010). [CrossRef]  

4. T. Bothe, W. S. Li, C. V. Kopylow, and W. Jüptner, “High-resolution 3D shape measurement on specular surfaces by fringe reflection,” Proc. SPIE 5457, 411–422 (2004). [CrossRef]  

5. Z. H. Zhang, Y. M. Wang, S. J. Huang, Y. Liu, C. X. Chang, F. Gao, and X. Q. Jiang, “Three-Dimensional shape measurements of specular objects using phase-measuring deflectometry,” Sensors 17(12), 2835 (2017). [CrossRef]  

6. Y. Tang, X. Y. Su, Y. K. Liu, and H. L. Jing, “3D shape measurement of the aspheric mirror by advanced phase measuring deflectometry,” Opt. Express 16(19), 15090–15096 (2008). [CrossRef]  

7. Y. Tang, X. Y. Su, F. Wu, and Y. K. Liu, “A novel phase measuring deflectometry for aspheric mirror test,” Opt. Express 17(22), 19778–19784 (2009). [CrossRef]  

8. L. Huang, C. S. Ng, and A. K. Asundi, “Dynamic three-dimensional sensing for specular surface with monoscopic fringe reflectometry,” Opt. Express 19(13), 12809 (2011). [CrossRef]  

9. H. W. Guo and T. Tao, “Specular surface measurement by using a moving diffusive structured light source,” Proc. SPIE 6834, 68343E (2007). [CrossRef]  

10. H. W. Guo, P. Feng, and T. Tao, “Specular surface measurement by using least squares light tracking technique,” Opt. Laser Eng. 48(2), 166–171 (2010). [CrossRef]  

11. L. Huang, J. P. Xue, B. Gao, C. Mcpherson, J. Beverage, and M. Idir, “Modal phase measuring deflectometry,” Opt. Express 24(21), 24649–24664 (2016). [CrossRef]  

12. L. Huang, J. P. Xue, B. Gao, and M. Idir, “Three-dimensional shape measurement with modal phase measuring deflectometry,” Proc. SPIE 1044909, 1–10 (2017). [CrossRef]  

13. M. M. Liu, R. Hartley, and M. Salzmann, “Mirror surface reconstruction from a single image,” 2013 IEEE Conference on Computer Vision and Pattern Recognition, pp. 129–136 (2013). [CrossRef]  

14. M. M. Liu, R. Hartley, and M. Salzmann, “Mirror surface reconstruction from a single image,” PAMI 37(4), 760–773 (2015). [CrossRef]  

15. M. Tarini, H. P. A. Lensch, M. Goesele, and H. P. Seidel, “3D acquisition of mirroring objects using striped patterns,” Graphical Models 27(4), 223–259 (2005). [CrossRef]  

16. S. Savarese, M. Chen, and P. Perona, “Local shape from mirror reflections,” Int. J. Comput Vision 64(1), 31–67 (2005). [CrossRef]  

17. Y. Liu, S. J. Huang, Z. H. Zhang, N. Gao, F. Gao, and X. Q. Jiang, “Full-field 3D shape measurement of discontinuous specular objects by direct phase measuring deflectometry,” Sci. Rep. 7(1), 10293 (2017). [CrossRef]  

18. P. Zhao, N. Gao, Z. H. Zhang, F. Gao, and X. Q. Jiang, “Performance analysis and evaluation of direct phase measuring deflectometry,” Opt. Laser Eng. 103, 24–33 (2018). [CrossRef]  

19. M. C. Knauer, J. Kaminski, and G. Hausler, “Phase measuring deflectometry: a new approach to measure specular free-form surfaces,” Proc. SPIE 5457, 545704 (2004). [CrossRef]  

20. H. Y. Ren, F. Gao, and X. Q. Jiang, “Iterative optimization calibration method for stereo deflectometry,” Opt. Express 23(17), 22060–22068 (2015). [CrossRef]  

21. J. T. Guan, J. Li, X. Yang, X. B. Chen, and J. T. Xi, “An improved geometrical calibration method for stereo deflectometry by using speckle pattern,” Opt. Commun. 505(15), 127507 (2022). [CrossRef]  

22. J. Y. Liu, M. J. Ren, F. Gao, and L. M. Zhu, “On-Machine calibration method for In Situ stereo deflectometry System,” IEEE Trans. Instrum Meas 70, 1–8 (2021). [CrossRef]  

23. W. H. Southwell, “Wave-front estimation from wave-front slope measurements,” J. Opt. Soc. Am. 70(8), 998–1006 (1980). [CrossRef]  

24. H. Ren, F. Gao, and X. Jiang, “Improvement of high-order least squares integration method for stereo deflectometry,” Appl. Opt. 54(34), 10249–10255 (2015). [CrossRef]  

25. H. Ren, F. Gao, and X. Jiang, “Least-squares method for data reconstruction from gradient data in deflectometry,” Appl. Opt. 55(22), 6052–6059 (2016). [CrossRef]  

26. L. Huang, J. P. Xue, B. Bao, C. Zuo, and M. Idir, “Zonal wavefront reconstruction in quadrilateral geometry for phase measuring deflectometry,” Appl. Opt. 56(18), 5139–5144 (2017). [CrossRef]  

27. C. Liu, Z. H. Zhang, N. Gao, and Z. Z. Meng, “Large-curvature specular surface phase measuring deflectometry with curved screen,” Opt. Express 29(26), 43327–43341 (2021). [CrossRef]  

28. H. Han, S. Wu, and Z. Song, “Curved LCD based deflectometry method for specular surface measurement,” Opt. Laser Eng. 151, 106909 (2022). [CrossRef]  

29. S. Lowitzsch, J. Kaminski, M. C. Knauer, and G. Hausler, “Vision and modeling of specular surfaces,” Proc. VMV 2005, 479–486 (2005). [CrossRef]  

30. V. Srinivasan, H. C. Liu, and M. Halioua, “Automated phase-measuring profilometry of 3-D diffuse objects,” Appl. Opt. 23(18), 3105–3108 (1984). [CrossRef]  

31. Z. Zhang, C. E. Towers, and D. P. Towers, “Time efficient color fringe projection system for 3D shape and color using optimum 3-frequency Selection,” Opt. Express 14(14), 6444–6455 (2006). [CrossRef]  

32. C. E. Towers, D. P. Towers, and J. D. C. Jones, “Generalized frequency selection in multifrequency interferometry,” Opt. Lett. 29(12), 1348–1350 (2004). [CrossRef]  

33. Z. Y. Zhang, “A flexible new technique for camera calibration,” IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000). [CrossRef]  

34. Y. L. Xiao, S. K. Li, Q. C. Zhang, J. X. Zhong, X. Y. Su, and Z. S. You, “Optical fringe-reflection deflectometry with bundle adjustment,” Opt. Laser Eng. 105, 132–140 (2018). [CrossRef]  

35. Y. L. Xiao, X. Y. Su, and W. J. Chen, “Flexible geometrical calibration for fringe-reflection3D measurement,” Opt. Lett. 37(4), 620–622 (2012). [CrossRef]  

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (16)

Fig. 1.
Fig. 1. Deflectometry system. (a). mono-PMD, (b). stereo-PMD.
Fig. 2.
Fig. 2. Diagram of the stereo-PMD.
Fig. 3.
Fig. 3. Diagram of stereo-PMD.
Fig. 4.
Fig. 4. Procedure of search p in subpixel level.
Fig. 5.
Fig. 5. Diagram of stereo-PMD calibration.
Fig. 6.
Fig. 6. Diagram of simulated system.
Fig. 7.
Fig. 7. RMS of reconstruction error.
Fig. 8.
Fig. 8. Hardware diagram of stereo-PMD system.
Fig. 9.
Fig. 9. Virtual plane fixed by featured points.
Fig. 10.
Fig. 10. Distribution of reprojection error,○ of camera 1, △ of camera 2.
Fig. 11.
Fig. 11. Calibrated stereo-PMD system.
Fig. 12.
Fig. 12. Specular cylinder, reflected fringe patterns and rectified phase maps. (a) specular cylinder, (b)-(c) reflected fringe patterns, (d)-(e) rectified phase maps.
Fig. 13.
Fig. 13. Reconstruction of specular cylinder. (a). Reconstruction by method in [1315], (b). initial reconstruction by stereo-PMD, (c). reconstruction by stereo-PMD with integration.
Fig. 14.
Fig. 14. Error of reconstruction to the benchmark. (a). initial reconstruction by stereo-PMD, (b). reconstruction by stereo-PMD with integration.
Fig. 15.
Fig. 15. Specular step, reflected fringe patterns and rectified phase maps. (a) specular step, (b)-(c) reflected fringe patterns, (d)-(e) rectified phase maps.
Fig. 16.
Fig. 16. Reconstruction of specular step. (a). Initial reconstruction by stereo-PMD, (b). reconstruction by stereo-PMD with integration.

Tables (1)

Tables Icon

Table 1. Actual distance, measurement distance of step and error by three calibration methods (mm)

Equations (5)

Equations on this page are rendered with MathJax. Learn more.

P right = R stereo P left + T stereo
p left ( v d i , R vp , T vp ) = ( I v d i v d i T | | v d i | | 2 ) R vp ( 1 0 0   0 1 0   0 0 1 ) X + ( I v d i v d i T | | v d i | | 2 ) T vp 2 v d i
p right ( v d i , R vp , T vp , R stereo , T stereo ) = R stereo p left ( v d i , R vp , T vp ) + T stereo
f ( A left , A right , v d k , R vp , T vp , R stereo , T stereo ) = i = 1 n j = 1 m { [ left  ( p left\_ i _ j ) p left\_ i _ j ] 2 + [ right  ( p right _ i _ j ) p right _ i _ j ] 2 }
I n o i s y = I i d e a l ( 1 + i 0.2 / 100 r a n d n )
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.