使用高解析度資料集於改善天空影像去背方法

An Improved Sky Image Matting Method with a High-Resolution Dataset

蔡政諺(Cheng-Yen Tsai)

指導教授 ： 莊永裕

國立臺灣大學/電機資訊學院/資訊工程學系/碩士(2024年)

https://doi.org/10.6342/NTU202400108

摘要

這篇論文提出了一個改善的天空影像去背方法。我們提出了一個高解析度的天空影像去背資料集，透過人工標註三分圖 (trimap) 並導入基於三分圖的影像去背網路，生成精確的天空透明遮罩 (alpha matte)。接著，我們修改了 PP-Matting，一種通用的影像去背網路，使其在天空影像去背上有更好的表現。具體來說，我們將 CoordConv 層和可訓練的導向濾波器整合到網路中，並進行初步研究以找到最佳設計。實驗結果展示，相較於現有的天空影像去背資料集，我們的資料集為各種影像去背網路提供了更好的訓練環境，無論是在量化指標還是視覺品質上。此外，我們修改過的網路架構在天空影像去背上，相較於現有方法具有更優秀的表現。

關鍵字

影像去背 ； 電腦視覺 ； 深度學習

並列摘要

This paper proposes an improved method for sky image matting. We present a high-resolution sky image matting dataset and generate accurate alpha mattes by leveraging a trimap-based image matting network with manually annotated trimaps. Next, we modify the architecture of PP-Matting, a general-purpose image matting network, to better suit the task of sky image matting. Specifically, we integrate CoordConv layers and a trainable guided filter into the network and conduct a preliminary study to find the optimal design. Experimental results demonstrate that our dataset provides a better training environment for various image matting networks compared to an existing sky image matting dataset in both quantitative metrics and visual quality. Additionally, our modified network shows superior performance compared to existing methods.

並列關鍵字

Image Matting ； Computer Vision ； Deep Learning

參考文獻

[1] G. Chen, Y. Liu, J. Wang, J. Peng, Y. Hao, L. Chu, S. Tang, Z. Wu, Z. Chen, Z. Yu, et al. Pp-matting: High-accuracy natural image matting. arXiv preprint arXiv:2204.09433, 2022.

[2] Y.-Y. Chuang, B. Curless, D. H. Salesin, and R. Szeliski. A bayesian approach to digital matting. In Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001, volume 2, pages II–II. IEEE, 2001.

[3] M.Cordts,M.Omran,S.Ramos,T.Rehfeld,M.Enzweiler,R.Benenson,U.Franke, S. Roth, and B. Schiele. The cityscapes dataset for semantic urban scene understanding. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 3213–3223, 2016.

[4] M. Forte and F. Pitié. f , b, alpha matting. arXiv preprint arXiv:2003.07711, 2020.

[5] K. He and J. Sun. Fast guided filter. arXiv preprint arXiv:1505.00996, 2015.