透過您的圖書館登入
IP:3.137.200.242
  • 期刊

基於自監督學習之超解析度成像法應用於Sentinel-2衛星影像

SELF-SUPERVISED SUPER-RESOLUTION ON SENTINEL-2 IMAGERY

摘要


近年卷積神經網路廣泛運用於超解析度成像法,這類監督式學習法能利用外部影像集訓練模型以提升特定特徵目標如人臉或建物的影像解析度,訓練過程耗費大量計算資源。本研究測試Assaf Shocher所開發Zero-shot Super-resolution(ZSSR)方法,應用提升Sentinel-2衛星影像之空間解析度。ZSSR屬於自監督學習方法,不需大量影像集的訓練,只針對測試影像本身內部結構特徵進行學習。實驗結果相較於傳統雙三次插值在峰值訊噪比(PSNR)及結構相似性(SSIM)能提升4.67%及3.35%,與耗費訓練資源的監督式學習方法成效相當。成果也顯示遙測影像中具重複性的內部結構特徵,適合應用自監督學習超解析度成像法提高空間解析度。

並列摘要


Convolutional neural networks have been adopted in super-resolution algorithm inrecent years. These supervised learning methods can train the model through external image sets to improve the image resolution of specific feature such as faces or buildings. Because they need large amount of training images, it usually consumes lots of computation cost. This study implements the Zero-shot Super-resolution (ZSSR) method developed by Assaf Shocher and applied to improve the spatial resolution of Sentinel-2 images. ZSSR is a self-supervised learning method that does not need the pre-training process with image data set. It only needs to learn the internal structural features of the test image itself. The experimental results show that ZSSR can improve peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) by 4.67% and 3.35% compared with bicubic interpolation, which are comparable to supervised learning methods that consume training resources. The results also show, that the repeated internal structural features in remote sensing images are suitable for self-supervised learning super-resolution algorithms.

參考文獻


LeCun, Y., Bottou, L., Bengio, Y., and Haffner, P., “Gradient-based learning applied to document recognition,” Proceedings of the IEEE, Vol. 86, No. 11, pp. 2278-2324 (1998).
He, K., Zhang, X., Ren, S., and Sun, J., “Deep residual learning for image recognition,” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770-778 (2016).
He, K., Zhang, X., Ren, S., and Sun, J., “Deep residual learning for image recognition,” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770-778 (2016).
黃吉宏、黃明鴻、吳宗達、陳明麗,「微型光學系統於微微衛星之應用」,科儀新知,第二十三卷,第二期,第 27-43 頁 (2001)。
陳昭偉,「利用超解析度技巧放大人臉與車牌影像」,碩士論文,中華大學資訊工程學系研究所,新竹 (2008)。

延伸閱讀