透過您的圖書館登入
IP:13.59.14.52
  • 學位論文

二維影像對三維影像轉換系統

2D to 3D Image Conversion System

指導教授 : 范育成
若您是本文的作者,可授權文章由華藝線上圖書館中協助推廣。

摘要


產生深度圖的規則是依照畫面當中每一個物體的表面與觀看者所在的實際距離紀錄每一個像素的深度。同一物件內的深度資訊並不會相差太多。因此,為了從單一張二維影像中取得深度圖,我們從畫面中的物件及紋路開始著手是合理的。我們先針對整張影像計算,求出消失點(Vanishing Point)的位置,並假設消失點是距離觀看者最遠的一點,因此越接近消失點的物件,我們賦予較深的深度值,反之亦然。在取得物件切割方面,我們提出以顏色為基礎的切割方式。產生深度圖之後,就可以依照深度圖對原本的影像加以變形,產生看似多個不同視角拍攝的影像(Multi-View)。在產生多視角影像之前,我們額外再對每一個像素的深度值轉換成人類可以接受的深度知覺,多加了這個轉換步驟是為了要在之後的影像變形(Image Warping)時減少破洞的產生。最後在以我們新提出的擬真形變方法產生多重視角影像。稱為栩栩如生影像三維形變(Vivid-DIBR),與傳統的三維形變差異在於,考慮到人類視覺的感受,因此我們提出一個新的轉換公式,我們使形變後的影像,以聚焦平面為基礎,將前景和後景分開並且反向計算,滿足實際情形,三維顯示器表面如同聚焦平面,而前景看似突出螢幕,後景如同內陷於螢幕之中,滿足觀測者的立體視覺。如此,二維圖像經過我們的系統後,即可以產生多視角影像,並且放到三維顯示器使用,產生可觀賞的立體影像。

關鍵字

DIBR 色彩物件分割 消失點 深度圖

並列摘要


The multiview perspectives are captured around a scene by camera array at the same time, and multi-view images can not only keep two dimensions information but also have the depth architecture of a scene. Most of 3D displays support the multi-view contents, while there is a bottleneck of 3D TV system to broadcast the larger storage and bandwidth for end-user. For saving bandwidth, a new TV broadcasting channel transfers third dimensional information i.e. depth map has been utilized. The 3D display renders intermediate image and a depth map to form different views, as well as synthesizes these images into one image; this technology is the renowned DIBR (Depth Image Base Rendering.) In other word, any 2D contents can be transformed into multi-view images according to their corresponding depth map. Our system processes 2D image to capture a depth map of the intermediate view image during 3D contents capturing. We utilize the vanishing point detection and color image segmentation technique to find the objects and deepest point (i.e. vanishing point) in the image, and then we assign depth value by comparing the vanishing point of object with image. After depth map generation, we propose the Vivid-DIBR system to imitate how human eyes see things. On the other hand, this system solves the holes (warping error points) problem by redistributing corresponding depth map. We implement the Vivid-DIBR by cell-based design flow and the 0.18um 1P6M implementation process of Taiwan Semiconductor Manufacturing Company. The design aims to convert 2D images into multi-view images which will be suitable for any interlacing 3D display by adjusting the focal plane location.

參考文獻


[1] Redert, A.; de Beeck, M.O.; Fehn, C.; Ijsselsteijn, W.; Pollefeys, M.; Van Gool, L.; Ofek, E.; Sexton, I.; and Surman, P., “Advanced Three-Dimensional Television System Technologies,” 3D Data Processing Visualization and Transmission, 2002. Proceedings. First International Symposium on 19-21, June 2002 p.p. 313 - 319
[5] C. Fehn, “A 3D-TV System Based on Video Plus Depth Information,” IEEE Conference Record of the Thirty-Seventh Asilomar Conference on Signals, Systems, and Computers, Nov. 2003, p.p. 1529-1533.
[6] L. Zhang; W. Tam; and D. Wang, “Stereoscopic Image Generation Based on Depth Images, ” IEEE International Conference on Image Processing (ICIP,) Oct. 2004, pp. 2993-2996.
[9] 張毓麟,二維及三維影像轉換之演算法及架構分析,博士,台灣大學,台北,2007。
[10] V. Cantoni; L. Lombardi; M. Porta; and N Sicard. “Vanishing point detection representation analysis and new approaches, ” Proceedings of the 11th International Conference on Image Analysis & Processing, September 2001, p.p. 90-94.

被引用紀錄


林炳璉(2011)。應用於古典文獻文物之二維對三維影像轉換晶片與系統設計〔碩士論文,國立臺北科技大學〕。華藝線上圖書館。https://www.airitilibrary.com/Article/Detail?DocID=U0006-0508201114433200
陳柏瑋(2011)。採用區塊斜率樣本之消失點偵測技術的二維至三維影像轉換系統〔碩士論文,國立臺北科技大學〕。華藝線上圖書館。https://www.airitilibrary.com/Article/Detail?DocID=U0006-1108201113461000
邱奕誌(2012)。運用重疊線來實現二維對三維影像轉換系統與晶片設計〔碩士論文,國立臺北科技大學〕。華藝線上圖書館。https://www.airitilibrary.com/Article/Detail?DocID=U0006-1708201210053600
張立承(2013)。基於深度影像重建技術實現二維至三維轉換系統與晶片設計〔碩士論文,國立臺北科技大學〕。華藝線上圖書館。https://www.airitilibrary.com/Article/Detail?DocID=U0006-1608201312353600

延伸閱讀