透過您的圖書館登入
IP:216.73.216.55
  • 學位論文

基於多模組卷積神經網路之單張影像除霧

UNet-AIR2: A Single Image Dehazing Network

指導教授 : 吳沛遠
若您是本文的作者,可授權文章由華藝線上圖書館中協助推廣。

摘要


在本文中,我們基於UNet和現有設計(包括聚合變換,初始模塊和遞歸殘差卷積神經網絡)的組合,提出UNet-AIR2作為有效的圖像去霧模型。 與以前的依賴於物理散射模型的方法不同,UNet-AIR2直接生成除霧後的圖像,而無需估計透射圖和大氣光。 為了更好地證明每個模塊的有效性,我們進行了消融研究,評估使用了峰值信噪比(PSNR),結構相似度(SSIM)和主觀視覺效果。 此外,我們確定了每個模塊在UNet-AIR2中有效的原因,並獲得了顯著圖以觀察每個輸出像素與輸入圖像之間的關係。 在合成數據集和真實數據集上進行的大量實驗表明,與現有的圖像霧度去除技術相比,該方法具有明顯的改進。

並列摘要


In this paper, we propose UNet-AIR2 as an effective image dehazing model, based on UNet and a combination of state-of-the-art designs, including the aggregated transformation, inception module, and recurrent residual convolutional neural network. Unlike previous methods that depend on physical scattering models, UNet-AIR2 directly generates the dehazed image without estimating the transmission map and atmospheric light. To better demonstrate the effectiveness of each module, we conduct an ablation study evaluated using the peak signal-to-signal (PSNR), Structural Similarity (SSIM), and subjective visual effects. Furthermore, we determine the reasons why each module is valid in UNet-AIR2, and we obtained a saliency map to observe how each output pixel is related to the input image. Extensive experiments on synthetic datasets and real-world datasets reveal that the proposed method has significant improvements over the existing state-of-the-art methods for image haze removal.

參考文獻


[1] J. Adebayo, J. Gilmer, M. Muelly, I. Goodfellow, M. Hardt, and B. Kim. Sanity checks for saliency maps. In Advances in Neural Information Processing Systems, pages 9505–9515, 2018.
[2] M. Z. Alom, M. Hasan, C. Yakopcic, T. M. Taha, and V. K. Asari. Recurrent residual convolutional neural network based on U-Net (R2U-net) for medical image segmentation. arXiv preprint arXiv:1802.06955, 2018.
[3] C. Ancuti, C. O. Ancuti, and R. Timofte. NTIRE 2018 Challenge on Image Dehazing: Methods and results. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pages 891–901, 2018.
[4] C. Ancuti, C. O. Ancuti, R. Timofte, and C. De Vleeschouwer. I-haze: A dehazing benchmark with real hazy and haze-free indoor images. In International Conference on Advanced Concepts for Intelligent Vision Systems, pages 620–631. Springer, 2018.
[5] C. O. Ancuti, C. Ancuti, M. Sbert, and R. Timofte. Dense haze: A benchmark for image dehazing with dense-haze and haze-free images. In IEEE International Conference on Image Processing (ICIP), IEEE ICIP 2019, 2019.

延伸閱讀