Image processing and analysis based on the use of phase information
Pavelyeva E.A.

 

Lomonosov Moscow State University, Faculty of Computational Mathematics and Cybernetics, Moscow, Russia

 PDF

Abstract:
The paper provides a review of main approaches to the use of phase information in image analysis, processing and reconstruction. The description of phase algorithms and examples of their use are given. A technique of the use of phase information based on the Hermite projection method is proposed.

Keywords:
phase, Fourier transform, image reconstruction, phase correlation, phase congruency, Hermite projection method.

Citation:
Pavelyeva EA. Image processing and analysis based on the use of phase information. Computer Optics 2018; 42(6): 1022-1034. DOI: 10.18287/2412-6179-2018-42-6-1022-1034.

References:

  1. Pavelyeva EA. The use of phase information in image processing [In Russian]. Proceedings of the International Conference GraphiCon2016 2016; 476-483.
  2. Bonnet N, Vautrot P. Image analysis: Is the Fourier transform becoming obsolete? Microsc Microanal Microstruct 1997; 8(1): 59-75. DOI: 10.1051/mmm:1997106.
  3. Oppenheim AV, Lim JS. The importance of phase in signals. Proceedings of the IEEE 1981; 69(5): 529-541. DOI: 10.1109/PROC.1981.12022.
  4. Ni X, Huo X. Statistical interpretation of the importance of phase information in signal and image reconstruction. Statistics & Probability Letters 2007; 77(4): 447-454. DOI: 10.1016/j.spl.2006.08.025.
  5. Guo C, Ma Q, Zhang L. Spatio-temporal Saliency detection using phase spectrum of quaternion Fourier transform. 2008 IEEE Conference on Computer Vision and Pattern Recognition 2008: 1-8. DOI: 10.1109/CVPR.2008.4587715.
  6. Skarbnik N, Sagiv C, Zeevi YY. Edge detection and skeletonization using quantized localized phase. 17th European Signal Processing Conference 2009; 1542-1546.
  7. Asghari MH, Jalali B. Edge detection in digital images using dispersive phase stretch transform. International Journal of Biomedical Imaging 2015; 2015: 687819. DOI: 10.1155/2015/687819.
  8. Kovesi P. Phase congruency detects corners and edges. Proc Digital Image Computing: Techniques and Applications (DICTA) 2003; 309-318.
  9. Narwaria M, Lin W, McLoughlin IV, Emmanuel S, Chia L-T. Fourier transform-based scalable image quality measure. IEEE Transactions on Image Processing 2012; 21(8): 3364-3377. DOI: 10.1109/TIP.2012.2197010.
  10. Wang D, Ding W, Man Y, Cui L. A joint image quality assessment method based on global phase coherence and structural similarity. 2010 3rd International Congress on Image and Signal Processing 2010; 5: 2307-2311. DOI: 10.1109/CISP.2010.5647786.
  11. Kim D-O, Park R-H. Image quality measure using the phase quantization code. IEEE Transactions on Consumer Electronics 2010; 56(2): 937-945. DOI: 10.1109/TCE.2010.5506023.
  12. Zhai G, Zhang W, Xu Y, Lin W. LGPS: Phase based image quality assessment metric. IEEE Workshop on Signal Processing Systems 2007: 605-609. DOI: 10.1109/SIPS.2007.4387618.
  13. Li L, Zou Q, Huang Q, Zhang Y, Wang F. Image fusion based on fractional Fourier domain phase and amplitude. Proc SPIE 2015; 9443: 94431B. DOI: 10.1117/12.2179513.
  14. Hassen R, Wang Z, Salama M. Multifocus image fusion using local phase coherence measurement. In: Kamel M, Campilho A, eds. Image Analysis and Recognition. Berlin, Heidelberg: Springer-Verlag; 2009: 54-63. DOI: 10.1007/978-3-642-02611-9_6.
  15. Zhan K, Li Q, Teng J, Wang M, Shi J. Multifocus image fusion using phase congruency. J Electron Imag 2015; 24(3): 033014. DOI: 10.1117/1.JEI.24.3.033014.
  16. Woo J, Hong B-W, Hu C-H, Shung KK, Kuo C-CJ, Slomka PJ. Non-rigid ultrasound image registration based on intensity and local phase information. Journal of Signal Processing Systems 2009; 54(1-3): 33-43. DOI: 10.1007/s11265-008-0218-2.
  17. Hassen R, Wang Z, Salama M. Multi-sensor image registration based-on local phase coherence. 16th IEEE International Conference on Image Processing (ICIP) 2009; 181-184. DOI: 10.1109/ICIP.2009.5414187.
  18. Mellor M, Brady M. Non-rigid multimodal image registration using local phase. In Book: Barillot Ch, Haynor DR, Hellier P, eds. Medical image computing and computer-assisted intervention (MICCAI '2004). Berlin, Heidelberg: Springer-Verlag; 2004: 789-796. DOI: 10.1007/978-3-540-30135-6_96.
  19. Reddy BS, Chatterji BN. An FFT-based technique for translation, rotation, and scale-invariant image registration. IEEE Transactions on Image Processing 1996; 5(8): 1266-1271. DOI: 10.1109/83.506761.
  20. Wong A, Orchard J. Robust multimodal registration using local phase-coherence representations. J Sign Process Syst2009; 54(1-3): 89-100. DOI: 10.1007/s11265-008-0202-x.
  21. Foroosh H, Zerubia JB, Berthod M. Extension of phase correlation to subpixel registration. IEEE Transactions on Image Processing 2002; 11(3): 188-200. DOI: 10.1109/83.988953.
  22. Lai L, Xu Z. Global motion estimation based on Fourier Mellin and phase correlation. 2nd International Conference on Civil, Materials and Environmental Sciences (CMES 2015) 2015; 636-639. DOI: 10.2991/cmes-15.2015.173.
  23. Alexiadis DS, Sergiadis GD. Motion estimation, segmentation and separation, using hypercomplex phase correlation, clustering techniques and graph-based optimization. Computer Vision and Image Understanding 2009; 113(2): 212-234. DOI: 10.1016/j.cviu.2008.08.013.
  24. Hua G, Orchard MT. Image inpainting based on geometrical modeling of complex wavelet coefficients. IEEE International Conference on Image Processing (ICIP) 2007; 1: 553-556. DOI: 10.1109/ICIP.2007.4379014.
  25. Daugman JG. High confidence visual recognition of persons by a test of statistical independence. IEEE Transactions on Pattern Analysis and Machine Intelligence 1993; 15(11): 1148-1161. DOI: 10.1109/34.244676.
  26. Daugman J. How iris recognition works. IEEE Transactions on Circuits and Systems for Video Technology 2004; 14(1): 21-30. DOI: 10.1109/TCSVT.2003.818350.
  27. Ito K, Aoki T. Phase-based image matching and its application to biometric recognition. Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA) 2013: 1-7. DOI: 10.1109/APSIPA.2013.6694297.
  28. Miyazawa K, Ito K, Aoki T, Kobayashi K, Nakajima H. A phase-based iris recognition algorithm. In Book: Zhang D, Jain AK, eds. Advances in biometrics. Berlin, Heidelberg: Springer; 2006; 3832: 356-365. DOI: 10.1007/11608288_48.
  29. Asaari MSM, Suandi SA, Rosdi BA. Fusion of band limited phase only correlation and width centroid contour distance for finger based biometrics. Expert Systems with Applications 2014; 41(7): 3367-3382. DOI: 10.1016/j.eswa.2013.11.033.
  30. Chan CH, Tahir MA, Kittler J, Pietikainen M. Multiscale local phase quantization for robust component-based face recognition using kernel fusion of multiple descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence 2013; 35(5): 1164-1177. DOI: 10.1109/TPAMI.2012.199.
  31. Punsawad Y, Wongsawat Y. Palmprint image enhancement using phase congruency. IEEE International Conference on Robotics and Biomimetics 2009; 1643-1646. DOI: 10.1109/ROBIO.2009.4913247.
  32. Rida I, Almaadeed S, Bouridane A. Gait recognition based on modified phase-only correlation. Signal, Image and Video Processing 2016; 10(3): 463-470. DOI: 10.1007/s11760-015-0766-4.
  33. Raja KB, Raghavendra R, Busch C. Video presentation attack detection in visible spectrum iris recognition using magnified phase information. IEEE Transactions on Information Forensics and Security 2015; 10(10): 2048-2056. DOI: 10.1109/TIFS.2015.2440188.
  34. Saratxaga I, Sanchez J, Wu Z, Hernaez I, Navas E. Synthetic speech detection using phase information. Speech Communication 2016; 81(C): 30-41. DOI: 10.1016/j.specom.2016.04.001.
  35. Wang Z, Simoncelli EP. Local phase coherence and the perception of blur. Proceedings of the 16th International Conference on Neural Information Processing Systems 2004: 1435-1442.
  36. Hassen R, Wang Z, Salama MM. Image sharpness assessment based on local phase coherence.IEEE Transactions on Image Processing 2013; 22(7): 2798-2810. DOI: 10.1109/TIP.2013.2251643.
  37. Blanchet G, Moisan L, Rougé B. Measuring the global phase coherence of an image. 15th IEEE International Conference on Image Processing 2008; 1176-1179. DOI: 10.1109/ICIP.2008.4711970.
  38. Blanchet G, Moisan L. An explicit sharpness index related to global phase coherence. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2012: 1065-1068. DOI: 10.1109/ICASSP.2012.6288070.
  39. Tiwari S, Shukla VP, Biradar SR, Singh AK. A blind blur detection scheme using statistical features of phase congruency and gradient magnitude. Advances in Electrical Engineering 2014; 2014: 521027. DOI: 10.1155/2014/521027.
  40. Kovesi P. Phase preserving denoising of images. Proceedings of the digital image computing: Techniques and applications (DICTA) 1999: 212-217.
  41. Wong A. Adaptive bilateral filtering of image signals using local phase characteristics. Signal Processing 2008; 88(6): 1615-1619. DOI: 10.1016/j.sigpro.2008.01.002.
  42. Belaid A, Boukerroui D, Maingourd Y, Lerallut J-F. Phase-based level set segmentation of ultrasound images. IEEE Transactions on Information Technology in Biomedicine 2011; 15(1): 138-147. DOI: 10.1109/TITB.2010.2090889.
  43. Hacihaliloglu I, Abugharbieh R, Hodgson A, Rohling R. Bone segmentation and fracture detection in ultrasound using 3D local phase features. In Book: D. Metaxas, L. Axel, G. Fichtinger, G. Székely, eds. Medical image computing and computer-assisted intervention (MICCAI 2008). Berlin, Heidelberg: Springer-Verlag; 2008: 287-295. DOI: 10.1007/978-3-540-85988-8_35.
  44. Weng JJ. Image matching using the windowed Fourier phase. International Journal of Computer Vision 1993; 11(3): 211-236. DOI: 10.1007/BF01469343.
  45. Zhou J, Xu Y, Yang X. Quaternion wavelet phase based stereo matching for uncalibrated images. Pattern Recogn Lett 2007; 28(12): 1509-1522. DOI: 10.1016/j.patrec.2007.03.009.
  46. Nagashima S, Aoki T, Higuchi T, Kobayashi K. A subpixel image matching technique using phase-only correlation. International Symposium on Intelligent Signal Processing and Communications (ISPACS'06) 2006: 701-704. DOI: 10.1109/ISPACS.2006.364751.
  47. Reddy V, Talari J. Color image registration and template matching using quaternion phase correlation. Ubiquitous Computing and Communication 2011; 6(1): 714-721.
  48. Jing X, Hong YX, Xin SX, Ying MX. Medical image mosaic technology based on image phase correlation. IEEE International Conference on Digital Home (ICDH) 2012: 274-277. DOI: 10.1109/ICDH.2012.51.
  49. Rahtu E, Heikkilä J, Ojansivu V, Ahonen T. Local phase quantization for blur-insensitive image analysis. Image and Vision Computing 2012; 30(8): 501-512. DOI: 10.1016/j.imavis.2012.04.001.
  50. Wang Z, Simoncelli EP. Translation insensitive image similarity in complex wavelet domain. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) 2005; 573-576. DOI: 10.1109/ICASSP.2005.1415469.
  51. Liu Z, Laganiere R. On the use of phase congruency to evaluate image similarity. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2006: 937-940. DOI: 10.1109/ICASSP.2006.1660498.
  52. Vasilenko GI, Taratorin AM. Image reconstruction [In Russian]. Moscow: "Radio i Svyaz" Publisher; 1986.
  53. Stark H, ed. Image recovery: Theory and application. Orlando, FL: Academic Press; 1987. ISBN: 978-0-12-414281-7.
  54. Hayes MH, Lim JS, Oppenheim AV. Signal reconstruction from phase or magnitude. IEEE Transactions on Acoustics, Speech, and Signal Processing 1980; 28(6): 672-680. DOI: 10.1109/TASSP.1980.1163463.
  55. Ma C. Novel criteria of uniqueness for signal reconstruction from phase. IEEE Transactions on Signal Processing 1991; 39(4): 989-992. DOI: 10.1109/78.80933.
  56. Levi A, Stark H. Signal restoration from phase by projections onto convex sets. Journal of the Optical Society of America 1983; 73(6): 810-822. DOI: 10.1364/JOSA.73.000810.
  57. Urieli S, Porat M, Cohen N. Optimal reconstruction of images from localized phase. IEEE Transactions on Image Processing 1998; 7(6): 838-853. DOI: 10.1109/83.679428.
  58. Petropulu AP, Nikias CL. Signal reconstruction from the phase of the bispectrum. IEEE Transactions on Signal Processing 1992; 40(3): 601-610. DOI: 10.1109/78.120803.
  59. Hua G, Orchard MT. Image reconstruction from the phase or magnitude of its complex wavelet transform. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2008: 3261-3264. DOI: 10.1109/ICASSP.2008.4518346.
  60. Pavelyeva EA, Krylov AS. Synthesis of phase and magnitude of images by Hermite projection method. Pattern Recognition and Image Analysis 2015; 25(2): 187-192. DOI: 10.1134/S1054661815020200.
  61. Pavelyeva EA, Krylov AS. The approximation of phase by Hermite projection method in image reconstruction from phase [In Russian]. Proceedings of the International Conference GraphiCon 2014: 131-134.
  62. Pavelyeva EA. The search for matches between the iris key points using Hermite projection phase-only correlation method [In Russian]. Systems and Means of Informatics 2013; 23(2): 74-88. DOI: 10.14357/08696527130206.
  63. Korchagine DN, Krylov AS. Projection filtering in image processing. Proceedings of the International Conference GraphiCon 2000: 42-45.
  64. Pavelyeva EA, Krylov AS. Detection of local shifts in iris image by Hermite projection phase-only correlation method [In Russian]. Proceedings of the International Conference GraphiCon 2011: 188-191.
  65. Pavelyeva EA, Krylov AS. An adaptive algorithm of iris image key points detection. Proceedings of the International Conference GraphiCon 2010; 320-323.
  66. Kovesi P. Image features from phase congruency. Videre: Journal of Computer Vision Research 1999; 1(3): 1-26.
  67. Morrone MC, Owens RA. Feature detection from local energy. Pattern Recognition Letters 1987; 6(5): 303-313. DOI: 10.1016/0167-8655(87)90013-4.
  68. Venkatesh S, Owens RA. On the classification of image features. Pattern Recognition Letters 1990; 11(5): 339-349. DOI: 10.1016/0167-8655(90)90043-2.
  69. Hassen RKM. Local phase coherence measurement for image analysis and processing. Ph. D. thesis, Waterloo, Ontario, Canada; 2013.
  70. Goodman JW, Silvestri AM. Some effects of Fourier-domain phase quantization. IBM Journal of Research andDevelopment 1970; 14(5): 478-484. DOI: 10.1147/rd.145.0478.
  71. Zhang B, Shan S, Chen X, Gao W. Histogram of gabor phase patterns (HGPP): A novel object representation approach for face recognition. IEEE Transactions on Image Processing 2007; 16(1): 57-68. DOI: 10.1109/TIP.2006.884956.
  72. Xie S, Shan S, Chen X, Chen J. Fusing local patterns of gabor magnitude and phase for face recognition. IEEE Transactions on Image Processing 2010; 19(5): 1349-1361. DOI: 10.1109/TIP.2010.2041397.
  73. Zhou S-R, Yin J, Zhang J-M. Local binary pattern (LBP) and local phase quantization (LBQ) based on Gabor filter for face representation. Neurocomputing 2013; 116: 260-264. DOI: 10.1016/j.neucom.2012.05.036.
  74. Lei Z, Li SZ. Fast multi-scale local phase quantization histogram for face recognition. Pattern Recognition Letters 2012; 33(13): 1761-1767. DOI: 10.1016/j.patrec.2012.06.005.
  75. Skarbnik N, Zeevi YY, Sagiv C. The Importance of phase in image processing. CCIT Technical Report #773. Haifa, Israel: Departament of Electrical Engineering, Israel Instritute of Technology; 2010.
  76. Ojansivu V, Heikkilä J. Blur insensitive texture classification using local phase quantization. In Book: Elmoataz A, Lezoray O, Nouboud F, Mammass D, eds. Image and Signal Processing 2008: 236-243. DOI: 10.1007/978-3-540-69905-7_27.
  77. Mallat S. A wavelet tour of signal processing. 2nd ed. London: Academic Press; 1999. ISBN: 978-0-12-466606-1.
  78. Tom V, Quatieri TF, Hayes MH, McClellan JH. Convergence of iterative nonexpansive signal reconstruction algorithms. IEEE Transactions on Acoustics, Speech, and Signal Processing 1981; 29(5): 1052-1058. DOI: 10.1109/TASSP.1981.1163681.
  79. Krylov AS, Korchagin DN. Fast Hermite projection method. In Book: Campilho A, Kamel MS, eds. Image Analysis and Recognition 2006: 329-338. DOI: 10.1007/11867586_31.
  80. Titchmarsh EC. Introduction to the theory of Fourier integrals. 2nd ed. Oxford: Clarendon Press; 1948.
© 2009, IPSI RAS
151, Molodogvardeiskaya str., Samara, 443001, Russia; E-mail: journal@computeroptics.ru ; Tel: +7 (846) 242-41-24 (Executive secretary), +7 (846) 332-56-22 (Issuing editor), Fax: +7 (846) 332-56-20