Document Type: Original Research Paper


Department of Surveying Engineering, Faculty of Civil Engineering, Shahid Rajaee Teacher Training University, Tehran 16785-136, Iran


Background and Objectives: High resolution multi-spectral (HRMS) images are essential for most of the practical remote sensing applications. Pan-sharpening is an effective mechanism to produce HRMS image by integrating the significant structural details of panchromatic (PAN) image and rich spectral features of multi-spectral (MS) images.
Methods: The traditional pan-sharpening methods incur disadvantages like spectral distortion, spatial artifacts and lack of details preservation in the fused image. The pan-sharpening approach proposed in this paper is based on integrating wavelet decomposition and convolutional sparse representation (CSR). The wavelet decomposition is performed on PAN and MS images to obtain low-frequency and high-frequency bands. The low-frequency bands are fused by exploring the CSR based activity level measurement.
Results: The HRMS image is restored by implementing the inverse transform on fused bands. The fusion rules are constructed, thus to transfer the crucial details from source images to the fused image effectively.
Conclusion: The proposed method produces HRMS images with rational spatial and spectral qualities. The visual outcomes and quantitative measures approve the eminence of the proposed fusion framework.


Main Subjects

[1] A. Kosari, A. Sharifi, A. Ahmadi, and M. Khoshsima, “Remote sensing satellite’s attitude control system: rapid performance sizing for passive scan imaging mode,” Aircr. Eng. Aerosp. Technol., vol. 92, no. 7, pp. 1073–1083, 2020.

[2] A. Sharifi, “Using Sentinel-2 Data to Predict Nitrogen Uptake in Maize Crop,” IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., vol. 13, pp. 2656–2662, 2020.

[3] H. Demirel and G. Anbarjafari, “Discrete wavelet transform-based satellite image resolution enhancement,” IEEE Trans. Geosci. Remote Sens., vol. 49, no. 6 PART 1, pp. 1997–2004, 2011.

[4] H. Abdi and L. J. Williams, “Principal component analysis,” Wiley Interdisciplinary Reviews: Computational Statistics, vol. 2, no. 4. pp. 433–459, 2010.

[5] M. Oza, H. Vaghela, and S. Bagul, “Semi-Supervised Image-To-Image Translation,” in Proceeding - 2019 International Conference of Artificial Intelligence and Information Technology, ICAIIT 2019, 2019, pp. 16–20.

[6] A. Garzelli, B. Aiazzi, L. Alparone, S. Lolli, and G. Vivone, “Multispectral pansharpening with radiative transfer-based detail-injection modeling for preserving changes in vegetation cover,” Remote Sens., vol. 10, no. 8, pp. 1–18, 2018.

[7] H. Loussifi, K. Nouri, and N. Benhadj Braiek, “A new efficient hybrid intelligent method for nonlinear dynamical systems identification: The Wavelet Kernel Fuzzy Neural Network,” Commun. Nonlinear Sci. Numer. Simul., vol. 32, pp. 10–30, 2016.

[8] S. Bama and D. Selvathi, “Despeckling of medical ultrasound kidney images in the curvelet domain using diffusion filtering and MAP estimation,” Signal Processing, vol. 103, pp. 230–241, 2014.

[9] Y. Leung, J. Liu, and J. Zhang, “An improved adaptive intensity-hue-saturation method for the fusion of remote sensing images,” IEEE Geosci. Remote Sens. Lett., vol. 11, no. 5, pp. 985–989, 2014.

[10] G. Plonka and J. Ma, “Curvelet-wavelet regularized split Bregman iteration for compressed sensing,” Int. J. Wavelets, Multiresolution Inf. Process., vol. 9, no. 1, pp. 79–110, 2011.

[11] L. Alparone, S. Baronti, B. Aiazzi, and A. Garzelli, “Spatial Methods for Multispectral Pansharpening: Multiresolution Analysis Demystified,” IEEE Trans. Geosci. Remote Sens., vol. 54, no. 5, pp. 2563–2576, 2016.

[12] Z. Omar and T. Stathaki, “Image fusion: An overview,” Proc. - Int. Conf. Intell. Syst. Model. Simulation, ISMS, vol. 2015-Septe, pp. 306–310, 2015.

[13] Z. Shao and J. Cai, “Remote Sensing Image Fusion with Deep Convolutional Neural Network,” IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., vol. 11, no. 5, pp. 1656–1669, 2018.

[14] C. Jiang, Q. Zhang, R. Fan, and Z. Hu, “Super-resolution CT Image Reconstruction Based on Dictionary Learning and Sparse Representation,” Sci. Rep., vol. 8, no. 1, 2018.

[15] X. Yang, L. Jian, B. Yan, K. Liu, L. Zhang, and Y. Liu, “A sparse representation based pansharpening method,” Futur. Gener. Comput. Syst., vol. 88, pp. 385–399, 2018.

[16] B. Johnson, “Effects of pansharpening on vegetation indices,” ISPRS Int. J. Geo-Information, vol. 3, no. 2, pp. 507–522, 2014.

[17] S. Sulochana, R. Vidhya, K. Mohanraj, and D. Vijayasekaran, “Effect of wavelet based image fusion techniques with principal component analysis (PCA) and singular value decomposition (SVD) in supervised classification,” Indian J. Geo-Marine Sci., vol. 46, no. 2, pp. 338–348, 2017.

[18] K. C. Jambu, S. D. Degadwala, and D. Agrawal, “Satellite Image Fusion Using Adaptive Pan-sharpening Filters,” vol. 21, no. 1, pp. 16–19.

[19] J. Yang and J. Zhang, “Parallel performance of typical algorithms in remote sensing-based mapping on a multi-core computer,” Photogramm. Eng. Remote Sensing, vol. 81, no. 5, pp. 373–385, 2015.

[20] G. Masi, D. Cozzolino, L. Verdoliva, and G. Scarpa, “Pansharpening by convolutional neural networks,” Remote Sens., vol. 8, no. 7, 2016.

[21] B. Wohlberg, “Efficient algorithms for convolutional sparse representations,” IEEE Trans. Image Process., vol. 25, no. 1, pp. 301–315, 2016.

[22] Y. Liu, X. Chen, R. K. Ward, and J. Wang, “Image Fusion with Convolutional Sparse Representation,” IEEE Signal Process. Lett., vol. 23, no. 12, pp. 1882–1886, 2016.

[23] J. Sulam, A. Aberdam, A. Beck, and M. Elad, “On Multi-Layer Basis Pursuit, Efficient Algorithms and Convolutional Neural Networks,” IEEE Trans. Pattern Anal. Mach. Intell., pp. 1–1, 2019.

[24] Y. Liu, S. Liu, and Z. Wang, “A general framework for image fusion based on multi-scale transform and sparse representation,” Inf. Fusion, vol. 24, pp. 147–164, 2015.

[25] S. Li, X. Kang, L. Fang, J. Hu, and H. Yin, “Pixel-level image fusion: A survey of the state of the art,” Inf. Fusion, vol. 33, pp. 100–112, 2017.

[26] A. Garzelli, “A Review of Image Fusion Algorithms Based on the Super-Resolution Paradigm,” Remote Sens., vol. 8, no. 10, p. 1, 2016.