深度影像渲染及深度圖編碼方法對人眼觀看3D視訊舒適度之影響

近年來3D電影越來越普及，隨著相關技術的迅速發展，人們現在可以不用到電影院，在家就能觀賞3D影片。但長時間觀看3D視訊，容易造成人眼疲勞以及產生不舒適感，這些不舒適感產生的原因，有一部分是來自生理層面，另一部分則來自3D視訊內容。目前的3D格式大多為2D影像加上深度圖，並利用深度影像渲染法(Depth-Image-Based Rendering, DIBR)去做3D影像合成，因此許多研究都針對3D視訊的合成過程作探討，包含深度圖編碼處理及空洞修補，但大多數研究都只探討其中一個課題而未有兩者整體的探討。因此本研究在深度圖編碼上選H.265/HEVC及H.264/AVC壓縮編碼標準，修補空洞部分則採用最近相鄰內插法及在快速行進修補法Fast Marching Method (FFM)來做修補。首先我們先將深度圖分別用兩種編碼方式做編碼，接著進行深度影像渲染，之後再去做空洞修補。最終會有四種結果產生，並利用平均意見分數(Mean Opinion Score, MOS)來評定觀看3D視訊時，人眼感受舒適度的程度。實驗結果顯示，利用H.265編碼搭配Fast Marching Method這個組合，在舒適度上來看，感受是最好的。此外，如果空洞修補的好，從品質上或是舒適度上都能有效提升。

關鍵字

深度影像渲染法、深度圖編碼、空洞修補、人眼視覺舒適度

並列摘要

In recent years, 3D movie is becoming more popular and accessble. With the fast development of related techonology, people are able to watch 3D video at home without going to the movie theater. However, when watching 3D video for a long time, our eyes become fatigue and visual discomfort appears. The cause of these discomforts can be categorized into two parts. One of the causes is in physiology and another one is the content of 3D video. At the present, most of the 3D formats adopt the approach of 2D with depth map, and use the depth image rendering method (Depth-Image-Based Rendering) to perform 3D image synthesis. As a result, many research works focus their studies on the process of 3D image synthesis, including depth map coding and hole-filling. However, most studies just focus on one of them, either depth map coding or hole-filling, but not both as a whole. In this thesis, we choose H.265/HEVC and H.264/AVC standards for depth map coding. Furthermore, we use nearest neighbor interpolation and Fast Marching Method for hole-filling. Firstly, we utilize two video coding methods to encode the depth map. We then implement DIBR, followed by carrying out the hole filling process. Finally, we generated four results, and used Mean Opinion Score (MOS) to assess the perfermance of visual comfort when watching 3D video. The experimental results show that we have better perfermance of visual comfort by using H.265/HEVC with Fast Marching Method. The result also proves that the better the quality of the hole filling is, more effectively the quality or the visual comfort could be enhanced.

並列關鍵字

depth-image-based rendering, depth map coding, hole filling, visual comfort

參考文獻

[10] 陳瑩山，「雙黃成3D ─探討3D的形成與壓力的由來」，《健康世界》，44-49頁，2011 年1月。

[3] A. Smolic, K. Mueller, P. Markle, P. Kauff, and T. Wiegand, “An Overview of Available and Emerging 3D Video Formats and Depth Enhanced Stereo as Efficient Generic Solution,” IEEE Conf. on Picture Coding Symposium, pp.1-4, 2009.

[4] P. Kauff, N. Atzpadin, C. Fehn, M. Müller, O. Schreer, O. A. Smolic, and R. Tanger, “Depth Map Creation and Image-Based Rendering for Advanced 3DTV Services Providing Interoperability and Scalability,” Image Commun., vol. 2, pp. 217-234, 2007.

[8] W. Chen, Y. Chang, S. Lin, L. Ding, and L. Chen, “Efficient Depth Image Based Rendering with Edge Dependent Depth Filter and Interpolation”, Proc. of ICME, pp.1314-1317, 2005.

[11] 林志祥， 3D影像之立體感與舒適度探討，國立交通大學應用藝術研究所博士論文，2014。

國際替代計量

深度影像渲染及深度圖編碼方法對人眼觀看3D視訊舒適度之影響

全文下載

主題瀏覽