近年卷積神經網路廣泛運用於超解析度成像法,這類監督式學習法能利用外部影像集訓練模型以提升特定特徵目標如人臉或建物的影像解析度,訓練過程耗費大量計算資源。本研究測試Assaf Shocher所開發Zero-shot Super-resolution(ZSSR)方法,應用提升Sentinel-2衛星影像之空間解析度。ZSSR屬於自監督學習方法,不需大量影像集的訓練,只針對測試影像本身內部結構特徵進行學習。實驗結果相較於傳統雙三次插值在峰值訊噪比(PSNR)及結構相似性(SSIM)能提升4.67%及3.35%,與耗費訓練資源的監督式學習方法成效相當。成果也顯示遙測影像中具重複性的內部結構特徵,適合應用自監督學習超解析度成像法提高空間解析度。
Convolutional neural networks have been adopted in super-resolution algorithm inrecent years. These supervised learning methods can train the model through external image sets to improve the image resolution of specific feature such as faces or buildings. Because they need large amount of training images, it usually consumes lots of computation cost. This study implements the Zero-shot Super-resolution (ZSSR) method developed by Assaf Shocher and applied to improve the spatial resolution of Sentinel-2 images. ZSSR is a self-supervised learning method that does not need the pre-training process with image data set. It only needs to learn the internal structural features of the test image itself. The experimental results show that ZSSR can improve peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) by 4.67% and 3.35% compared with bicubic interpolation, which are comparable to supervised learning methods that consume training resources. The results also show, that the repeated internal structural features in remote sensing images are suitable for self-supervised learning super-resolution algorithms.