Shape from mixed polarization
Taamazyan V.A.

 

Moscow Institute of Physics and Technology

 PDF

Abstract:
In this paper, we propose a new method that jointly uses viewpoint and polarization data to holistically separate diffuse and specular components, recover refractive index, and ultimately recover the 3D shape of an object. By involving the physics of polarization in the separation process, we demonstrate competitive results with a benchmark method, while recovering additional information (e.g. refractive index).

Keywords:
scattering, polarization, three-dimensional sensing, shape from polarization, separating reflection components, refractive index estimation, polarized 3D.

Citation:
Taamazyan VA. Shape from mixed polarization. Computer Optics 2018; 45(5): 764-771. – DOI: 10.18287/2412-6179-2018-42-5-764-771.

References:

  1. Atkinson GA, Hancock ER. Recovery of surface orientation from diffuse polarization. IEEE Transactions on Image Processing 2006; 15(6): 1653-1664. DOI: 10.1109/TIP.2006.871114.
  2. Kadambi A, Taamazyan V, Shi B, Raskar R. Polarized 3D: High-quality depth sensing with polarization cues. In Book: Proceedings of the IEEE International Conference on Computer Vision 2015: 3370-3378. DOI: 10.1109/ICCV.2015.385.
  3. Miyazaki D, Tan RT, Hara K, Ikeuchi K. Polarization-based inverse rendering from a single view. In Book: Proceedings of the Ninth IEEE International Conference on Computer Vision 2003: 982-987. DOI: 10.1109/ICCV.2003.1238455.
  4. Tan RT, Ikeuchi K. Separating reflection components of textured surfaces using a single image. IEEE Trans Pattern Anal Mach Intell 2005; 27(2): 178-193.  DOI: 10.1109/TPAMI.2005.36.
  5. Morel O, Meriaudeau F, Stolz C, Gorria P. Polarization imaging applied to 3D reconstruction of specular metallic surfaces. Proc SPIE 2005; 5679: 187-186. DOI: 10.1117/12.586815.
  6. Saito M, Sato Y, Ikeuchi K, Kashiwagi H. Measurement of surface orientations of transparent objects using polarization in highlight. Systems and Computers in Japan 2001; 32(5): 64-71. DOI: 10.1002/scj.1027.
  7. Miyazaki D, Kagesawa M, Ikeuchi K. Transparent surface modeling from a pair of polarization images. IEEE Transactions on Pattern Analysis and Machine Intelligence 2004; 26(1): 73-82. DOI: 10.1109/TPAMI.2004.1261080.
  8. Miyazaki D, Shigetomi T, Baba M, Furukawa R, Hiura S, Asada N. Polarization-based surface normal estimation of black specular objects from multiple viewpoints. 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission 2012: 104-111. DOI: 10.1109/3DIMPVT.2012.14.
  9. Zappa CJ, Banner ML, Schultz H, Corrada-Emmanuel A, Wolff LB, Yalcin J. Retrieval of short ocean wave slope using polarimetric imaging. Measurement Science and Technology 2008; 19(5): 055503. DOI: 10.1088/0957-0233/19/5/055503.
  10. Nishino K, Zhang Z, Ikeuchi K. Determining reflectance parameters and illumination distribution from a sparse set of images for view-dependent image synthesis. In Book: Proc Eighth IEEE International Conference on Computer Vision (ICCV 2001) 2001; 1: 599-606. DOI: 10.1109/ICCV.2001.937573.
  11. Lin, S., Shum, H.Y.: Separation of diffuse and specular reflection in color images. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2001) 2001; 1: I-341-I-346. DOI: 10.1109/CVPR.2001.990495.
  12. Lin S, Li Y, Kang SB, Tong X, Shum HY. Diffuse-specular separation and depth recovery from image sequences. ECCV '02 Proceedings of the 7th European Conference on Computer Vision 2002: III: 210-224. DOI: 10.1007/3-540-47977-5_14.
  13. Tan RT, Nishino K, Ikeuchi K. Separating reflection components based on chromaticity and noise analysis. IEEE Trans Pattern Anal Mach Intell 2004; 26(10): 1373-1379. DOI: 10.1109/TPAMI.2004.90.
  14. Ma WC, Hawkins T, Peers P, Chabert CF, Weiss M, Debevec P. Rapid acquisition of specular and diffuse normal maps from polarized spherical gradient illumination. EGSR'07 Proceedings of the 18th Eurographics conference on Rendering Techniques 2007: 183-194. DOI: 10.2312/EGWR/EGSR07/183-194.
  15. Ghosh A, Fyffe G, Tunwattanapong B, Busch J, Yu X, Debevec P. Multiview face capture using polarized spherical gradient illumination. ACM Transactions on Graphics 2011; 30(6): 129. DOI: 10.1145/2070781.2024163.
  16. Nayar SK, Fang XS, Boult T. Separation of reflection components using color and polarization. International Journal of Computer Vision 1997; 21(3): 163-186. DOI: 10.1023/A:1007937815113.
  17. Zickler T, Ramamoorthi R, Enrique S, Belhumeur PN. Reflectance sharing: Predicting appearance from a sparse set of images of a known shape. IEEE Trans Pattern Anal Mach Intell 2006; 28(8): 1287-1302. DOI: 10.1109/TPAMI.2006.170.
  18. Guarnera GC, Peers P, Debevec P, Ghosh A. Estimating surface normal from spherical stokes reflectance fields. ECCV'12 Proceedings of the 12th international conference on Computer Vision 2012; 2: 340-349. DOI: 10.1007/978-3-642-33868-7_34.
  19. Schechner YY, Narasimhan SG, Nayar SK. Instant dehazing of images using polarization. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2001) 2001; 1: I–325-I–332. DOI: 10.1109/CVPR.2001.990493.
  20. Cula OG, Dana KJ, Pai DK, Wang D. Polarization multiplexing and demultiplexing for appearance-based modeling. IEEE Trans Pattern Anal Mach Intell 2007; 29(2): 362-367. DOI: 10.1109/TPAMI.2007.39.
  21. Schechner YY, Nayar SK. Generalized mosaicing: Polarization panorama. IEEE Trans Pattern Anal Mach Intell 2005; 27(4): 631-636. DOI: 10.1109/TPAMI.2005.79.
  22. Treibitz T, Schechner YY. Active polarization descattering. IEEE Trans Pattern Anal Mach Intell 2009; 31(3): 385-399. DOI: 10.1109/TPAMI.2008.85.
  23. Lanman D, Wetzstein G, Hirsch M, Heidrich W, Raskar R. Polarization fields: Dynamic light field display using multi-layer LCDs. ACM Transactions on Graphics 2011; 30(6): 186. DOI: 10.1145/2070781.2024220.
  24. Schechner YY. Self-calibrating imaging polarimetry. IEEE International Conference on Computational Photography (ICCP) 2015. DOI: 10.1109/ICCPHOT.2015.7168374.
  25. Wolff LB, Boult TE. Constraining object features using a polarization reflectance model. IEEE Trans Pattern Anal Mach Intell 1991; 13(7): 635-657. DOI: 10.1109/34.85655.
  26. Rahmann S, Canterakis N. Reconstruction of specular surfaces using polarization imaging. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2001) 2001; 1: I–149-I–155. DOI: 10.1109/CVPR.2001.990468.
  27. Hecht E. Optics. 4th ed. San Francisco: Addison-Wesley; 2002. ISBN: 978-0-8053-8566-3.
  28. Jakob W. Mitsuba renderer. Source: áhttp://www.mitsuba-renderer.orgñ.
  29. Izadi S, Kim D, Hilliges O, Molyneaux D, Newcombe R, Kohli P, Shotton J, Hodges S, Freeman D, Davison A, Fitzgibbon A. Kinectfusion: Real-time 3D reconstruction and interaction using a moving depth camera. UIST '11 Proceedings of the 24th annual ACM symposium on User interface software and technology 2011: 559-568. DOI: 10.1145/2047196.2047270.
  30. Wetzstein G, Raskar R, Heidrich W. Hand-held schlieren photography with light field probes. 2011 IEEE International Conference on Computational Photography (ICCP) 2011. DOI: 10.1109/ICCPHOT.2011.5753123.
© 2009, IPSI RAS
151, Molodogvardeiskaya str., Samara, 443001, Russia; E-mail: journal@computeroptics.ru ; Tel: +7 (846) 242-41-24 (Executive secretary), +7 (846) 332-56-22 (Issuing editor), Fax: +7 (846) 332-56-20