Image quality improvement of parallel four-step phase-shifting digital holography by using the algorithm of parallel two-step phase-shifting digital holography Takashi Kakue, 1 Yuri Moritani, 1 Kenichi Ito, 1 Yuki Shimozato, 1 Yasuhiro Awatsuji, 1,* Kenzo Nishio, 2 Shogo Ura, 1 Toshihiro Kubota, 3 and Osamu Matoba 4 1 Graduate School of Science and Technology, Kyoto Institute of Technology, Matsugasaki, Sakyo-ku, Kyoto, 606-8585, Japan 2 Advanced Technology Center, Kyoto Institute of Technology, Sakyo-ku, Kyoto, 606-8585, Japan 3 Kubota Holography Laboratory Corporation, Nishihata 34-1-609, Ogura-cho, Uji, Kyoto, 611-0042, Japan 4 Graduate School of Engineering, Kobe University, Rokkodai 1-1, Nada, Kobe, 657-8501, Japan *awatsuji@kit.ac.jp Abstract: We propose an algorithm that can improve the quality of the reconstructed image from the single hologram recorded by the optical system of the parallel four-step phase-shifting digital holography. The proposed algorithm applies the image-reconstruction algorithm of parallel two-step phase-shifting digital holography to the hologram so as to reduce errors in the reconstructed image and eliminate ghosts. We numerically and experimentally confirmed that the proposed algorithm decreased 25% in terms of root mean square error in amplitude, and eliminated the ghosts, respectively. 2010 Optical Society of America OCIS codes: (090.0090) Holography; (090.1995) Digital holography, (090.1760) Computer holography, (090.2880) Holographic interferometry, (100.2980) Image enhancement, (100.3010) Image reconstruction techniques. References and links 1. J. W. Goodman, and R. W. Lawrence, Digital image formation from electronically detected holograms, Appl. Phys. Lett. 11(3), 77 79 (1967). 2. M. A. Kronrod, N. S. Merzlyakov, and L. Yaroslavskii, Reconstruction of a hologram with a computer, Sov. Phys. Tech. Phys. 17, 333 334 (1972). 3. T.-C. Poon, Recent progress in optical scanning holography, J. Hologr. Speckle 1(1), 6 25 (2004). 4. T.-C. Poon, ed., Digital holography and three-dimensional display: Principles and Applications, (Springer, 2006). 5. U. Schnars, and W. Jueptner, Digital Holography, (Springer, 2005). 6. S. Murata, S. Hayashida, and Y. Tanaka, Simultaneous measurement of particle depth and size using digital holography, in Proc 9th Int. Symp. Flow Visual., (Edinburgh, 2000) 371.1 6. 7. T. Yamaguchi, S. Murata, and T. Morihara, Three-dimensional flow measurement by digital holographic particle image velocimetry with spatio-temporal derivative method, JSME Int. J. 49, 1133 1140 (2005). 8. B. Javidi, and E. Tajahuerce, Three-dimensional object recognition by use of digital holography, Opt. Lett. 25(9), 610 612 (2000). 9. B. Javidi, I. Moon, S. Yeom, and E. Carapezza, Three-dimensional imaging and recognition of microorganism using single-exposure on-line (SEOL) digital holography, Opt. Express 13(12), 4492 4506 (2005), http://www.opticsinfobase.org/oe/abstract.cfm?uri=oe-13-12-4492. 10. T. Nomura, and B. Javidi, Object recognition by use of polarimetric phase-shifting digital holography, Opt. Lett. 32(15), 2146 2148 (2007). 11. K. J. Chalut, W. J. Brown, and A. Wax, Quantitative phase microscopy with asynchronous digital holography, Opt. Express 15(6), 3047 3052 (2007), http://www.opticsinfobase.org/oe/abstract.cfm?uri=oe-15-6-3047. 12. P. Ferraro, L. Miccio, S. Grilli, M. Paturzo, S. De Nicola, A. Finizio, R. Osellame, and P. Laporta, Quantitative phase microscopy of microstructures with extended measurement range and correction of chromatic aberrations by multiwavelength digital holography, Opt. Express 15(22), 14591 14600 (2007), http://www.opticsinfobase.org/oe/abstract.cfm?uri=oe-15-22-14591. 13. C. P. McElhinney, B. M. Hennelly, and T. J. Naughton, Extended focused imaging for digital holograms of macroscopic three-dimensional objects, Appl. Opt. 47(19), D71 D79 (2008). (C) 2010 OSA 26 April 2010 / Vol. 18, No. 9 / OPTICS EXPRESS 9555
14. X. F. Xu, L. Z. Cai, Y. R. Wang, X. F. Meng, W. J. Sun, H. Zhang, X. C. Cheng, G. Y. Dong, and X. X. Shen, Simple direct extraction of unknown phase shift and wavefront reconstruction in generalized phase-shifting interferometry: algorithm and experiments, Opt. Lett. 33(8), 776 778 (2008). 15. P. Gao, B. Yao, N. Lindlein, K. Mantel, I. Harder, and E. Geist, Phase-shift extraction for generalized phaseshifting interferometry, Opt. Lett. 34(22), 3553 3555 (2009). 16. T. Nomura, S. Mikan, Y. Morimoto, and B. Javidi, Secure optical data storage with random phase key codes by use of a configuration of a joint transform correlator, Appl. Opt. 42(8), 1508 1514 (2003). 17. O. Matoba, and B. Javidi, Secure three-dimensional data transmission and display, Appl. Opt. 43(11), 2285 2291 (2004). 18. E. Pérez-Cabré, M. S. Millán, and B. Javidi, Near infrared multifactor identification tags, Opt. Express 15(23), 15615 15627 (2007), http://www.opticsinfobase.org/oe/abstract.cfm?uri=oe-15-23-15615. 19. I. Yamaguchi, and T. Zhang, Phase-shifting digital holography, Opt. Lett. 22(16), 1268 1270 (1997). 20. M. Sasada, Y. Awatsuji, and T. Kubota, Parallel quasi-phase-shifting digital holography that can achieve instantaneous measurement, in Technical Digest of the 2004 ICO International Conference: Optics and Photonics in Technology Frontier (International Commission for Optics, 2004), (Chiba, 2004) pp. 187 188. 21. M. Sasada, A. Fujii, Y. Awatsuji, and T. Kubota, Parallel quasi-phase-shifting digital holography implemented by simple optical set up and effective use of image-sensor pixels, in Technical Digest of the 2004 ICO International Conference: Optics and Photonics in Technology Frontier (International Commission for Optics, 2004), (Chiba, 2004) pp. 357 358. 22. Y. Awatsuji, M. Sasada, and T. Kubota, Parallel quasi-phase-shifting digital holography, Appl. Phys. Lett. 85(6), 1069 1071 (2004). 23. A. Fujii, Y. Awatsuji, and T. Kubota, Parallel quasi-phase-shifting color digital holography, in Technical Digest of Annual Meeting of the Optical Society of Japan 2005 (Optics Japan 2005), (Tokyo, 2005) pp. 256 257, (in Japanese). 24. Y. Awatsuji, A. Fujii, T. Kubota, and O. Matoba, Parallel three-step phase-shifting digital holography, Appl. Opt. 45(13), 2995 3002 (2006). 25. J. Millerd, N. Brock, J. Hayes, M. North-Morris, M. Novak, and J. Wyant, Pixelated phase-mask dynamic interferometer, Proc. SPIE 5531, 304 314 (2004). 26. S. Yoneyama, H. Kikuta, and K. Moriwaki, Instantaneous phase-stepping interferometry using polarization imaging with a micro-retarder array, Exp. Mech. 45(5), 451 456 (2005). 27. S. Murata, D. Harada, and Y. Tanaka, Spatial phase-shifting digital holography or three-dimensional particle tracking velocimetry, Jpn. J. Appl. Phys. 48(9), 09LB01 (2009). 28. Y. Awatsuji, T. Tahara, A. Kaneko, T. Koyama, K. Nishio, S. Ura, T. Kubota, and O. Matoba, Parallel two-step phase-shifting digital holography, Appl. Opt. 47(19), D183 D189 (2008). 29. T. Kakue, T. Tahara, K. Ito, Y. Shimozato, Y. Awatsuji, K. Nishio, S. Ura, T. Kubota, and O. Matoba, Parallel phase-shifting color digital holography using two phase shifts, Appl. Opt. 48(34), H244 H250 (2009). 30. X. F. Meng, L. Z. Cai, X. F. Xu, X. L. Yang, X. X. Shen, G. Y. Dong, and Y. R. Wang, Two-step phase-shifting interferometry and its application in image encryption, Opt. Lett. 31(10), 1414 1416 (2006). 31. M. Zecchino, Dynamic interferometry: Beating vibration, Nat. Photonics 2(11), 664 666 (2008). 32. http://www.photonic-lattice.com/en/pol_camera0.html Digital holography (DH) [1 5] is a technique that records holograms by use of an image sensor and reconstructs the image of objects by computer. This technique is capable of threedimensional (3-D) image capturing and has been actively researched in many fields such as particle measurement [6,7], object recognition [8 10], phase and object imaging [11 13], phase-shift extraction [14,15], and encryption and information security [16 18]. In particular, in-line DH has been frequently employed because the pixel pitch of an image sensor is too large to record fine interference fringes generated by off-axis holography. In in-line DH, the reference wave is perpendicularly incident to an image sensor, so that the quality of the reconstructed image degrades. This is because the 0th-order diffraction image and the conjugate image are superimposed on the desired image of objects. Phase-shifting digital holography (PSDH) [19] is one of the powerful techniques which can obtain only the desired image. PSDH sequentially records several holograms by use of reference waves with several phase shifts to retrieve the original complex amplitude of the object wave. However, it is useless for the instantaneous measurement of moving objects due to the sequential recording of several holograms. Then, we proposed parallel PSDH [20 24] which was capable of the instantaneous measurement. This technique records an interference fringe image, in which several holograms required for phase-shifting interferometry are spatially multiplexed, with a single-shot exposure. Several parallel PSDHs have been reported [20 26]. However, PSDH has such the problem that the sampling interval of interference fringes is large because of the spatial multiplexing. Then, aliasing arises and the quality of the reconstructed images degrades due to aliasing. Although most of parallel PSDHs uses four phase shifts [20,21,25 (C) 2010 OSA 26 April 2010 / Vol. 18, No. 9 / OPTICS EXPRESS 9556
27], the quality of the reconstructed image is degraded according to the number of the multiplexing. It is one of the most important issues for the parallel PSDHs to improve the quality of the reconstructed image. Then, we proposed a parallel PSDH which uses only two phase shifts to improve the image quality [28,29]. This parallel PSDH is based on the phaseshifting interferometry by use of two phase shits [30]. Although the technique of Ref. 30 sequentially records two holograms, the parallel PSDH we proposed records the information of the two holograms with a single-shot exposure. However, no image sensor required for parallel two-step PSDH [28] has been developed yet. On the other hand, some image sensors that can be used for parallel four-step PSDH have already been commercially available [31,32]. Moreover, only the results of the preliminary experiment using sequentially recorded holograms were shown and parallel PSDHs have not been experimentally demonstrated yet in Refs [28,29]. In this paper, we propose an algorithm for improving the quality of the reconstructed image in parallel four-step PSDH and experimentally demonstrate a parallel PSDH using the proposed algorithm. This algorithm applies the image-reconstruction algorithm of parallel two-step PSDH to the hologram recorded by the image sensor, which is commercially available, required for parallel four-step PSDH. Figure 1(a) shows an example of the optical implementation of parallel four-step PSDH. This implementation is based on the one shown in Ref. 25. The wave emitted from the light source passes through half-wave plate and is collimated. After that, the wave is split into two waves by the first polarizing beam splitter (PBS). The polarization directions of the two waves are orthogonal to each other. One wave illuminates the object and the wave diffracted or diffused from the object is called the object wave. The other is called the reference wave. The second PBS aligns the object wave and the reference wave. A quarter-wave plate (QWP) is oriented at 45 to the polarization direction of the reference wave. Then, the QWP transform the object wave and the reference wave into circular polarization waves. Because the polarization directions of the two waves are orthogonal to each other before entering the QWP, the two circular polarization waves rotate counter each other. The interference fringe image formed by the reference wave and the object wave is recorded by an image sensor on which a phase-shifting array device is attached. The polarization array shown in Fig. 1(b) is used for the phase-shifting array device. Therefore, a hologram containing the information of the four holograms, which is required for four-step PSDH, can be recorded with a single-shot exposure as shown in Fig. 1(c). Fig. 1. Schematic diagrams of parallel four-step PSDH. (a) An example of optical implementation, (b) configuration of polarization array for the phase-shifting array device, (c) recorded hologram. Figure 2 shows the schematic flow of parallel four-step PSDH. Holograms of each phase shift are extracted from the recorded hologram. The values of the vacant pixels are interpolated by the use of those of the adjacent pixels. Then, the four holograms I(0), I(-π/2), I(-π), I( 3π/2) required for four-step phase-shifting interferometry are generated by computer. By applying the phase-shifting method [19] to the four holograms, the complex amplitude distribution on the image sensor plane is obtained. Then, the 0th-order diffraction image and (C) 2010 OSA 26 April 2010 / Vol. 18, No. 9 / OPTICS EXPRESS 9557
the conjugate image are eliminated and only the image of the object can be reconstructed by computer. Fig. 2. Schematic flow of parallel four-step PSDH. We propose an algorithm that can improve the quality of the images reconstructed from the single hologram recorded by the optical system of parallel four-step PSDH. In the reconstruction, we apply the image-reconstruction algorithm of parallel two-step PSDH [28] to the four holograms recorded by the image sensor with the phase-shifting array device required for parallel four-step PSDH. Figure 3 shows the schematic flow of the proposed algorithm. The four holograms I(0), I(- π/2), I(-π), I( 3π/2) are generated from the single hologram recorded by the image sensor with the phase-shifting array device required for parallel four-step PSDH as shown in Fig. 1. We calculate the odd rows of the complex-amplitude distributions of object on the image sensor plane u 0 (x, y) by applying the calculation algorithm of parallel two-step PSDH to the data of pixels in the odd rows of I(0) and I(-π/2). The even rows of the complex-amplitude distributions of object on the image sensor plane u π (x, y) is similarly calculated by using the data of pixels in the even rows in I(-π) and I( 3π/2). And then, we obtain the complex amplitude distribution u(x, y) by combining the data of pixels in the odd rows of u 0 (x, y) with those in the even rows of u π (x, y). Finally, the image of object can be reconstructed by Fresnel transform [5] of u(x, y). Fig. 3. Processing procedure of the proposed algorithm. To confirm the validity of the proposed algorithm, we conducted a numerical simulation. Figures 4(a) and 4(b) show the objects. Each image consists of 256 256 pixels. The pixel size of an image sensor and the wavelength of a light source were assumed to be 5 µm 5 µm and 532 nm, respectively. It was assumed that the distance between the object and the image sensor was 26 cm. Figures 4(c) and 4(d) are the images reconstructed by the proposed algorithm. The images reconstructed by parallel four-step PSDH are shown in Figs. 4(e) and 4(f), for comparison. In addition, the magnified images of the reconstructed images by the proposed algorithm and by the parallel four-step one are shown in Figs. 4(g) and 4(h), respectively. While the details of the object were blurry in Fig. 4(h), the proposed algorithm (C) 2010 OSA 26 April 2010 / Vol. 18, No. 9 / OPTICS EXPRESS 9558
enabled to clearly reconstruct the details of the object as shown in Fig. 4(g). In parallel PSDH, the error by the interpolation of holograms causes the degradation of the image quality. The larger the number of the interpolated pixels is, the lower the quality of the image reconstruction is. The number of the interpolated pixels in the proposed algorithm is less than that in the parallel four-step one in the calculation of image reconstruction. Therefore, the proposed algorithm can improve the quality of the reconstructed image owing to the reduction of the number of the interpolated pixels. To quantitatively evaluate the numerical results, we calculated root mean square errors (RMSEs) between the original images and the reconstructed images obtained by each algorithm. Table 1 shows the RMSEs. The pixel values in the amplitude and phase distributions were normalized in range from 0 to 255 and from 0 to 2π, respectively. The closer RMSEs are to 0, the less error in reconstructed images is. The RMSEs of the proposed algorithm is superior to and equal to those of the parallel four-step algorithm in the amplitude distributions and the phase distributions, respectively. The proposed algorithm decreased 25% in terms of RMSE in amplitude. Thus, we confirm the validity of the proposed algorithm. Fig. 4. Object and reconstructed images. Amplitude distributions of (a) object, (b) proposed algorithm, (c) parallel four-step algorithm. Phase distributions of (d) object, (e) proposed algorithm, (f) parallel four-step algorithm. Table 1. RMSEs between the original images and the reconstructed images obtained by the proposed algorithm and the parallel four-step one Method Amplitude Phase Proposed 19.1 1.7 Parallel four-step 25.5 1.7 To demonstrate the proposed algorithm experimentally, we recorded holograms using the image sensor on which the phase-shifting array device used for parallel four-step PSDH was attached. We used a CCD camera with 1167 (H) 874 (V) pixels. The configuration of the phase-shifting array device was the same as that shown in Fig. 1(b). A Nd:YVO4 laser operated at 532 nm was used as an optical source. Figure 5(a) shows the object made of a sheet of a transparent film on which the letter R was printed. The size of the letter was 13 mm (H) 15 mm (V). The distance between the object and the image sensor was 26 cm. Figures 5(b) and 5(c) show the reconstructed image by the proposed algorithm and the parallel four-step algorithm, respectively. These images were reconstructed from only the central parts of 512 512 pixels of recorded holograms. Ghosts appeared at the side of the desired image in the parallel four-step algorithm. On the other hand, the proposed algorithm succeeded in eliminating the 0th-order diffraction image and the conjugate image from the desired image #124789 - $15.00 USD (C) 2010 OSA Received 26 Feb 2010; revised 2 Apr 2010; accepted 2 Apr 2010; published 22 Apr 2010 26 April 2010 / Vol. 18, No. 9 / OPTICS EXPRESS 9559
and clearly reconstructed the image of object. Although clarification of the cause of the ghost suppression by the proposed algorithm is under way, we consider that the proposed algorithm improved the image quality by decreasing the number of the interpolated pixels that affected the reconstructed image. The proposed algorithm can more precisely record the holograms and more clearly reconstruct images than the parallel four-step one. Thus, we have experimentally verified that the proposed algorithm was capable of improving the quality of images reconstructed from a hologram recorded by parallel four-step PSDH. Fig. 5. Photograph and reconstructed images. (a) Photograph of the object, (b) reconstructed image by the proposed algorithm, (c) reconstructed image by the parallel four-step algorithm. In conclusion, we proposed an algorithm that can improve the image quality reconstructed by parallel four-step PSDH. The proposed algorithm applies the reconstruction algorithm of parallel two-step PSDH to the hologram recorded by the optical system of parallel four-step PSDH. The effectiveness of the proposed algorithm was numerically confirmed by evaluating the results using RMSEs. Furthermore, we experimentally demonstrated that the proposed algorithm can more clearly reconstruct the images of object. The proposed algorithm contributes to high-accuracy 3-D measurement for dynamically moving objects such as flow, particles, micro-electro-mechanical systems, living cells and so on. This study was partially supported by Industrial Technology Research Grant Program from New Energy and Industrial Technology Development Organization (NEDO) of Japan. (C) 2010 OSA 26 April 2010 / Vol. 18, No. 9 / OPTICS EXPRESS 9560