Open Access Open Access  Restricted Access Subscription or Fee Access

Performance Evaluation of Quality Measurement for Super-Resolution Satellite Images

Hatem Magdy Keshk, M. Moustafa Abdel-Aziem, Ashraf K. Helmy, M.A. Assal

Abstract


Super resolution (SR) image reconstruction refers to a process of generating high resolution image from several low resolution images. There is a high demand for high-resolution satellite sensing in modern applications. SR offers an affordable solution for this high demand. The accuracy of super resolution depends on the accuracy of determining the difference between the low-resolution images. The widespread use of super-resolution methods, in a variety of applications such as remote sensing has led to an increasing need for or quality assessment measures. Assessment for image quality traditionally needs its original image as a reference. The traditional method for assessment like Peak Signal to Noise Ratio (PSNR) or Mean Square Error (MSE) difficult when there is no reference. This paper is focused on No-Reference (NR) quality measures for SR images using blur and sharpness (CPBD, LPC-SI). A non-reference objective measure is proposed, which aims to evaluate the quality of the super-resolution satellite images that are constructed without the need for a full reference condition and the result will be reliable. This article presents an overview assessment of SR techniques and measuring the quality of the image. We illustrate shift estimation which is the first and the most critical step in super resolution. Then several super resolution reconstruction techniques have been discussed and compared. Satellite images (SPOT-5) and other Remote Sensing (RS) data are used in the experiment. The images have sub pixel shifts 0.5 in the horizontal and vertical directions respectively.


Keywords


Super-Resolution, Reconstruction Algorithms, Satellite Images, Quality Measures, Full-Reference, Non-Reference

Full Text:

PDF

References


Basic Vivek Bannore, “Iterative-Interpolation Super-Resolution Image Reconstruction,” Studies in Computational Intelligence,Volume 195, 2009, pp 1-8.

T. Ahmad and S. S. Quershi, “The full reference quality assessment metrics for super resolution of an image: Shedding light or casting shadows?”, in Proc. of the Int. Conference on Electronics and Information Engineering (ICEIE) , vol.2, pp.V2-224-V2-227, 2010.

S. Jahanbin and R. Naething, “Super-resolution Image Reconstuction Performance”, The University of Texas at Austin, 2005.

Y. J. Kim, J. H. Park, G. S. Shin, H.-S. Lee, D.-H. Kim, S. H. Park, and J. Kim, “Evaluating super resolution algorithms”, in Proc. of the SPIE-IS&T Electronic Imaging, Image Quality and System Performance VIII, vol. 7867, pp. 78670D-78670D-7, 2011.

Tsai and Huang R. Y. Tsai and T. S. Huang, “Multiframe image restoration and registration,” tech. rep., Greenwich, CT, 1984.

P. Vandewalle, S. Süsstrunk and M. Vetterli, “A Frequency Domain Approach to Registration of Aliased Images with Application to Super-Resolution”, EURASIP Journal on Applied Signal Processing, pp. 1-14, 2006.

Kyle Nelson,“Performance Evaluation of Multi-Frame Super-resolution Algorithms”, [online]. https://www.researchgate.net/publication/236455157_Performance_evaluation_of_multi-frame_super-resolution_algorithms

B. Marcel, M. Briot, and R. Murrieta, Calcul de Translation et Rotation par la Transformation de Fourier, Traitement du Signal, vol. 14, no. 2, pp. 135-149, 1997.

L. Lucchese and G. M. Cortelazzo, “A noise-robust frequency domain technique for estimating planar roto-translations”, IEEE Trans. Signal Process., vol. 48, no. 6, pp. 1769-1786, 2000.

D. Keren, S. Peleg, and R. Brada, “Image Sequence Enhancement Using Sub-pixel Displacements”, in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 742-746, 1988.

Shahryar Shafique Qureshi, Xue Ming Li, Toufeeq Ahmad, “Investigating Image Super Resolution Techniques: What to Choose?”, ICACT ISBN 978-89-5519-163-9, Feb 2012.

J. J. Clark, M. R. Palmer, and P. D. Lawrence, “A transformation method for the reconstruction of functions from non-uniformly spaced samples,” IEEE Trans. Acoust. Speech, Signal Processing, vol. 33, no.4, pp. 1151–1165, 1985.

S.P. Kim and N.K. Bose, “Reconstruction of 2-D bandlimited discrete signals from nonuniform samples,” Proc. Inst. Elec. Eng., vol. 137, pt. F, pp. 197-204, June 1990.

A.M. Tekalp, M.K. Ozkan, and M.I. Sezan, “High-resolution image reconstruction from lower-resolution image sequences and space varying image restoration,” in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), San Francisco, CA., vol. 3, Mar. 1992, pp. 169-172.

A.J. Patti, M.I. Sezan, and A.M. Tekalp, “Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time,” IEEE Trans. Image Processing, vol. 6, no. 8, pp. 1064-1076, Aug. 1997.

H.J. Trussell and M.T. Civanlar, “Feasible solution in signal restoration,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-32, pp. 201-212, Mar. 1984.

A. Papoulis, “A new algorithm in spectral analysis and band-limited extrapolation”,IEEE Trans. Circuits Syst.,vol.22, no.9,pp.735-742, 1975.

R. W. Gerchberg, “Super-resolution through error energy reduction”, Optica Acta, vol. 21, no. 9, pp. 709-720, 1974.

Deepesh Jain, “Superresolution using Papoulis-Gerchberg Algorithm”, EE392J – Digital Video Processing, Stanford University, Stanford, CA, [online]. http://www.stanford.edu/class/ee392j/Winter2004/projects/Deepesh/ee392j_project.doc

M. Irani and S. Peleg, “Improving resolution by image registration,” CVGIP: Graphical Models and Image Proc., vol. 53, pp. 231-239, May 1991.

M. Irani and S. Peleg, “Motion analysis for image enhancement resolution, occlusion, and transparency,” J. Visual Commun. Image Represent., vol. 4, pp. 324-335, Dec. 1993.

A. Zomet, A. Rav-Acha, and S. Peleg, “Robust superresolution,” in Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR ’01), vol. 1, pp. 645–650, Kauai, Hawaii, USA, December 2001.

Tuan Q. Pham, Lucas J. van Vliet and Klamer Schutte, Robust Fusion of Irregularly Sampled Data Using Adaptive Normalized Convolution, EURASIP Journal on Applied Signal Processing, Vol. 2006, Article ID 83268, 12 pages, 2006.

Z. Wang, A. C. Bovik, H. R. Sheikh and E. P. Simoncelli, “Image quality assessment: From error visibility to structural similarity”, IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, 2004.

Z. Wang, A.C. Bovik, and L. Lu, “Why is image quality assessment so difficult?”, Proc. IEEE Inter. Conference Acoustics, Speech, and Signal Processing(ICASSP-2002),Vol.4, pp. 3313-3316, Orlando, FL, 13-17 May 2002.

R. Ferzli and L. J. Karam, “No-reference objective wavelet based noise immune image sharpness metric,” in Proc. IEEE Int. Conf. Image Processing, Sep. 2005, vol. 1, pp. 405–408.

R. Ferzli and L. J. Karam, “A No-Reference Objective Image Sharpness Metric Based on the Notion of Just Noticeable Blur (JNB)”, IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 18, NO. 4, 2009.

J. G. Robson and N. Graham, “Probability summation and regional variation in contrast sensitivity across the visual field,” Vis. Res., vol. 21, no. 3, pp. 409–418, 1981.

Rania Hassen, Zhou Wang and Magdy Salama, “NO-REFERENCE IMAGE SHARPNESS ASSESSMENT BASED ON LOCAL PHASE COHERENCE MEASUREMENT”, IEEE International Conference on Acoustics, Speech & Signal Processing (ICASSP10), Dallas, TX, Mar. 2010.

C. Fratter, M. Moulin, H. Ruiz, P. Charvet, and D. Zobler, “The SPOT5 mission”, 52nd International Astronautical Congress, Toulouse, France, vol. 35, no. 9–11, pp.651–660, 2001.

online]avilabel:http://tools.assembla.com/svn/all_projects_trunk/superresolution/SR_documentation.m.

Min Goo Choi,Jung Hoon Jung and Jea Wook Jeon, “No-Reference Image Quality Assessment using Blur and Noise”, world Academy of Scinece, Engineering and Technology,2009,Vol:26,2009-02-20.


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.