基於區塊相似度和幾何距離的影像放大演算法

Image Super Resolution Algorithm Based on Patch Similarity and Geometric Distance

陳璽文(Hsi-Wen Chen)

指導教授 ： 張隆紋

國立清華大學/電機資訊學院/資訊工程學系/碩士(2012年)

摘要

現今隨著大螢幕顯示器的普及，人們對於影像解析度大小的要求越來越高，但是由於數位影像擷取時可能限制於設備的功能或儲存容量的大小，往往只能取得解析度較低之影像，如果要將這些低解析度數位影像轉移於另一個高解析度之設備播放時，就必須運用影像處理中放大的技術，而影像內插就是一種常用於影像放大時的技術，但是傳統影像內插技術存在著許多問題，例如影像放大後會使得物體邊緣模糊或產生鋸齒狀，因而降低影像的視覺品質。

本論文提出一種判斷邊緣方向的方法，將邊緣的資訊區分為五大類，並且根據不同類型的邊緣資訊，設計五種對應的參考像素樣板，最後再提出一種結合影像中像素距離與結構相似性之間的關係，根據像素之間彼此距離的遠近以及像素周圍結構的相似性，為每一個參考的像素定義最合適的權重，經由加權總合內插得到放大後所遺失的像素。經由實驗結果可以顯示出，在影像放大之後，無論是任何角度的邊緣，比起其他方法都可以得到較清晰的視覺品質以及較高的PSNR(Peak Signal to Noise Ratio)值。

關鍵字：影像放大、判斷邊緣方向、參考像素樣板、非線性內插

關鍵字

影像放大 ； 判斷邊緣方向 ； 參考像素樣板 ； 非線性內插

並列摘要

As large screen display devices become popular, people ask high-resolution images. However, due to the limitation of the digital image cameras, the captured images tend to be the low-resolution images. If we display these low-resolution images on a high-resolution display device, we must use a super-resolution technique of the image processing. The image interpolation is one common technique to do super-resolution. The traditional image interpolation techniques have many problems, such as the blurring edges or jaggies on the edge region, therefore reduces the visual quality of the image.

In our thesis, we proposed a simple edge direction detection method which classifies the local information of a missing pixel into five categories when we want to interpolate it for a high-resolution image. According to its type of edge direction we designed five templates of the reference pixels. Finally, we proposed a nonlinear interpolation algorithm which combines the geometric distance weight and patch similarity weight to determine an optimal weight for every reference pixel. Through the weighted sum of all reference pixels then we interpolate the missing pixels. The experiment result shows that no matter any direction of the edges, the proposed algorithm can obtain sharper edges and clear visual quality than other methods, and it also can increase the PSNR.

Key word: super-resolution, edge direction detection, templates of the reference pixels, nonlinear interpolation

並列關鍵字

super-resolution ； edge direction detection ； templates of the reference pixels ； nonlinear interpolation

參考文獻

[1] T. Lehmann, C. Gönner, and K. Spitzer, “Survey: Interpolation methods in medical image processing,” IEEE Trans. Med. Imag., vol. 18, no. 11, pp. 1049–1075, Nov. 1999.

[2] T.Blu, P. Thevenaz, and M. unser, “Linear interpolation revitalized,” IEEE Trans. Image Processing, vol. 13, no.5, pp.710-719, may 2004.

[3] R. Gonzalez and R. Woods, digital Image Processing, 2nd ed. Upper Saddle River, Nj: Prentice-Hall, 2002.

[4] H.S. Hou and H.C.Andrews,”Cublic splines for image interpolation and digital filtering,” IEEE Trans. Acoust., Speech, Signal Process.,vol. ASSP-26, no.6, pp.508-517,Jun.1978.

[5] T. Lehmann, C. Gönner, and K. Spitzer, “Survey: Interpolation methods in medical image processing,” IEEE Trans. Med. Image., vol. 18, no.11, pp.1049-1075.