基於深度學習之敦煌壁畫復原之研究

Dunhuang Mural Restoration using Deep Learning

王瀚磊(Han-Lei Wang)

指導教授 ： 李明穗

共同指導教授 ： 洪一平

國立臺灣大學/電機資訊學院/資訊工程學研究所/碩士(2018年)

https://doi.org/10.6342/NTU201801130

摘要

敦煌石窟藝術主要以建築、雕塑、壁畫三種藝術形式為主。隨著時間的流逝，現今的敦煌石窟藝術早已蒙受巨大的損壞，造成難以修復的情形。隨著科技的發展，許多人開始利用數位保留技術將現今的石窟保存，甚至可以透過虛擬實境技術觀察敦煌石窟之數位復原內容。透過將石窟建模、並將壁畫保存為紋理，我們可以在虛擬環境中觀察到石窟的現況，彷彿置身其中。然而我們仍然無法一窺當年石窟尚未損壞的盛景。
近代深度學習技術興起並被廣泛地利用在各種不同的領域，本篇論文係提出一套系統性的修復流程，針對高解析度之各類破損壁畫紋理進行修復。我們採用深度學習領域中之生成式對抗網路技術，廣泛讓電腦觀看損壞後的壁畫以及修復後的壁畫並且學習兩種影像之轉換。透過訓練此模型，我們可以同時產生高解析度但色彩不一致，以及低解析度但色彩一致之結果。利用影像處理技術即可結合高解析度以及顏色一致之特性，得到最佳之修復效果。

關鍵字

敦煌石窟 ； 壁畫復原 ； 高解析度 ； 深度學習 ； 生成式對抗網路

並列摘要

The art of Dunhuang Grottoes is mainly composed of three forms: building, sculpture, and murals. With the passage of time, the art of Dunhuang Grottoes has suffered from tremendous damage, and making it difficult to repair. With Virtual Reality, we can even observe the digital preservation of Dunhuang Caves in virtual environment as if we are in Dunhuang by modeling the caves and preserve mural as textures. However, we still cannot have a glimpse of how the grottoes look like without damage.
With the ever-changing nature of deep learning, it is widely used in many fields. In this work, we propose a systematic restoration process for high-resolution types of deteriorated mural textures. We use the Generative Adversarial Network technology in deep learning. By making the machine learn the transformation between deteriorated mural textures and restored mural textures, we can simultaneously produce high-resolution but color-inconsistent, as well as low-resolution but color-consistent results. After post-processing through digital image processing technology, we can get both high-resolution and color-consistent texture.

並列關鍵字

Dunhuang Grottoes ； Mural Restoration ； High-resolution ； Deep Learning ； Generative Adversarial Network

參考文獻

[1] Xiangyang LI, Dongming LU and Yunhe PAN, "Virtual Dunhuang Mural Restoration System in Collaborative Network Environment, " in Comput. Graph. Forum 19(3): 331-340 (2000).

[2] Hongfang Han and Dongming Lu, "Computer Aided Protection and Restoration of Dunhuang Mural, " in Systems, Man and Cybernetics, 2004.

[3] Pan Yunhe, "Dunhuang Art Cave Virtual Rebuilding and Navigation, " in Dunhuang Arts in Gu, J. Wei, Z (eds) CAADRIA ‘99, Shanghai Scientific and Technological Literature Publishing House, Shanghai, pp. 1-20.

[4] E. Reinhard, M. Adhikhmin, B. Gooch, and P. Shirley, "Color Transfer between Images, " in IEEE Computer Graphics and Applications, 2001.

[5] Marcelo Bertalmio, Guillermo Sapiro, Vicent Caselles and Coloma Ballester, "Image Inpainting, " in SIGGRAPH Proceedings of the 27th annual conference on Computer graphics and interactive techniques, 2000, Pages 417-424.