A parallel fusion method of remote sensing image based on NSCT
Xue X., Xiang F., Wang H.

 

The School of Computer and Information Engineering, Anyang Normal University, Anyang 455000, Henan, China

 PDF

Abstract:
Remote sensing image fusion is very important for playing the advantages of a variety of remote sensing data. However, remote sensing image fusion is large in computing capacity and time consuming. In this paper, in order to fuse remote sensing images accurately and quickly, a parallel fusion algorithm of remote sensing image based on NSCT (nonsubsampled contourlet transform) is proposed. In the method, two important kinds of remote sensing image, multispectral image and panchromatic image are used, and the advantages of parallel computing in high performance computing and the advantages of NSCT in information processing are combined. In the method, based on parallel computing, some processes with large amount of calculation including IHS (Intensity, Hue, Saturation) transform, NSCT, inverse NSCT, inverse IHS transform, etc., are done. To realize the method, multispectral image is processed with IHS transform, and the three components, I, H, and S are gotten. The component I and the panchromatic image are decomposed with NSCT. The obtained low frequency components of NSCT are fused with the fusion rule based on the neighborhood energy feature matching, and the obtained high frequency components are fused with the fusion rule based on the subregion variance. Then the low frequency components and the high frequency components after fusion are processed with the inverse NSCT, and the fused component is gotten. Finally, the fused component, the component H and the component S are processed with the inverse IHS transform, and the fusion image is obtained. The experiment results show that the proposed method can get better fusion results and faster computing speed for multispectral image and panchromatic image.

Keywords:
image fusion, remote sensing image, panchromatic image, multispectral image, nonsubsampled contourlet transform, IHS transform, parallel computing.

Citation:
Xue X., Xiang F., Wang H. A parallel fusion method of remote sensing image based on NSCT. Computer Optics 2019; 43(1): 123-131. DOI: 10.18287/2412-6179-2019-43-1-123-131.

References:

  1. Yang Y, Que Y, Huang S, Lin P. Multiple visual features measurement with gradient domain guided filtering for multisensor image fusion. IEEE Transactions on Instrumentation and Measurement 2017; 66(4): 691-703. DOI: 10.1109/TIM.2017.2658098.
  2. Song H, Liu Q, Wang G, Hang R, Huang B. Spatio­temporal satellite image fusion using deep convolutional neural networks. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 2018; 11(3): 821-829. DOI: 10.1109/JSTARS.2018.2797894.
  3. Chen Y, Guan J, Cham W-K. Robust multi-focus image fusion using edge model and multi-matting. IEEE Transactions on Image Processing 2018; 27(3): 1526-1541. DOI: 10.1109/TIP.2017.2779274.
  4. Luo X, Zhang Z, Zhang B, Wu X. Image fusion with contextual statistical similarity and nonsubsampled shearlet transform. IEEE Sensors Journal 2017; 17(6):1760-1771. DOI: 10.1109/JSEN.2016.2646741.
  5. Chien C-L, Tsai W-H. Image fusion with no gamut problem by improved nonlinear HIS transforms for remote sensing. IEEE Transactions on Geoscience and Remote Sensing 2014; 52(1): 651-663. DOI: 10.1109/TGRS.2013.2243157.
  6. Da Cunha AL, Zhou J, Do MN. The nonsubsampled Contourlet transform: Theory, design, and applications. IEEE Transactions on Image Processing 2006; 15(10): 3089-3101. DOI: 10.1109/TIP.2006.877507.
  7. Do MN, Vetterli M. Framing pyramids. IEEE Transactions on Signal Processing 2003; 51(9): 2329-2342. DOI: 10.1109/TSP.2003.815389.
  8. Do MN, Vetterli M. The Contourlet transform: an efficient directional multiresolution image representation. IEEE Transactions on Image Processing 2005; 14(12): 2091-2106. DOI: 10.1109/TIP.2005.859376.
  9. Bhatnagar G, Wu QMJ, Liu Z. Directive contrast based multimodal medical image fusion in NSCT domain. IEEE Transactions on Multimedia 2013, 15(5): 1014-1024. DOI: 10.1109/TMM.2013.2244870.
  10. da Cunha AL, Zhou J, Do MN. The nonsubsampled Contourlet transform: Theory, design, and applications. IEEE Transactions on Image Processing 2006; 15(10): 3089-3101. DOI: 10.1109/TIP.2006.877507.
  11. Shahdoosti HR, Ghassemian H. Fusion of MS and PAN images preserving spectral quality. IEEE Geoscience and Remote Sensing Letters 2015; 12(3): 611-615. DOI: 10.1109/LGRS.2014.2353135.
  12. Choi J, Yu K, Kim Y. A new adaptive component substitution based satellite image fusion by using partial replacement. IEEE Transactions on Geoscience and Remote Sensing 2010; 49(1): 295-309. DOI: 10.1109/TGRS.2010.2051674.
  13. Ma J, Gong M, Zhou Z. Wavelet fusion on ratio images for change detection in SAR images. IEEE Geoscience and Remote Sensing Letters 2012; 9(6): 1122-1126. DOI: 10.1109/LGRS.2012.2191387.
  14. Qingxi T, Zheng W. Beijing-1 micro-satellite and its data applications. Spacecraft Engineering 2007; 16(2): 1-5.
  15. Ban Y, Jacob A. Object-based fusion of multitemporal multiangle ENVISAT ASAR and HJ-1B multispectral data for urban land-cover mapping. IEEE Transactions on Geoscience and Remote Sensing 2013; 51(4): 1998-2006. DOI: 10.1109/TGRS.2012.2236560.
  16. Jiang Y, Wang M. Image fusion using multiscale edge-preserving decomposition based on weighted least squares filter. IET Image Processing 2014; 8(3): 183-190. DOI: 10.1049/iet-ipr.2013.0429.
  17. Miao Z, Shi W, Samat A, Lisini G, Gamba P. Information fusion for urban road extraction from VHR optical satellite images. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 2016; 9(5): 1817-1829. DOI: 10.1109/JSTARS.2015.2498663.
  18. Aulí-Llinàs F, Enfedaque P, Moure JC, Sanchez V. Bitplane image coding with parallel coefficient processing. IEEE Transactions on Image Processing 2016; 25(1): 209-219. DOI: 10.1109/TIP.2015.2484069.
  19. Mandhare RA, Upadhyay P, Gupta S. Pixel-level image fusion using brovey transforme and wavelet transform. International Journal of Advanced Research in Electrical, Electronics and Instrumentation Engineering 2013; 2(6): 2690-2695.
  20. Zhang S, Yang G, Cheng Z, van de Wetering H, Ikuta C, Nishio Y. A novel optimization design approach for Contourlet directional filter banks. IEICE Electronics Express 2014; 11(17): 1-11. DOI: 10.1587/elex.11.20140556.
© 2009, IPSI RAS
151, Molodogvardeiskaya str., Samara, 443001, Russia; E-mail: journal@computeroptics.ru ; Tel: +7 (846) 242-41-24 (Executive secretary), +7 (846)332-56-22 (Issuing editor), Fax: +7 (846) 332-56-20