二維視訊中以物件追蹤及深度圖轉換之三維立體顯示技術

Converting 2D Video Sequences Using Object Tracking and Depth-Maps for 3D Stereoscopic Display

林進星(Chin-Hsin Lin)

指導教授 ： 張元翔

中原大學/工學院/資訊工程研究所/碩士(2007年)

https://doi.org/10.6840/cycu200700375

摘要

本論文提出一個以影像訊框內之消失線及消失點為基礎，將2D 視訊轉換至3D 立體顯示之電腦程式架構。給定一個單眼視角的2D 視訊，其主要處理流程是自動分割及追蹤移動物件，再根據景象的消失點(Vanishing Point)產生一個深度圖(Depth-Map)，並計算出移動物件的移動路徑深度。根據這個結果，雙眼視角影像就能被產生及重新結合成為立體顯示。本研究結果具有發展性，因為觀賞者將注意力轉向移動物件而產生的虛擬3D經歷。此外，移動物件也可以更進一步放置在各種不同背景之上，產生特別的3D效果。總結而言，我們的電腦程式架構提供一個有系統的方法來產生3D 立體顯示視訊，特別是在各種不同單眼視角場景中移動物件的3D 經歷。

關鍵字

消失點 ； 追蹤 ； 立體顯示 ； 深度圖

並列摘要

A computer framework for the conversion of 2D video sequence to 3D for stereoscopic display based on inside of image frame of vanishing lines and vanishing point is presented. Given a 2D video sequence in a single-view scene, the main processes were to automatically segment and track moving objects, and to generate a depth-map with respect to a vanishing point for the scene. Depths of the motion path for the moving object could be estimated accordingly. As a result, binocular-view images were generated and recombined for stereoscopic display. The experimental results are promising, because of virtual 3D experience due to moving objects that draw attention of viewers. In addition, special 3D effects could be created with the moving objects that were further superimposed onto various backgrounds. In conclusion, our computer framework provides a systematic way of creating 3D video sequence for stereoscopic display, especially for 3D experience of moving objects in various single-view scenes.

並列關鍵字

stereoscopic display ； tracking ； vanishing point ； depth-map

參考文獻

[6] 李獻仁，“立體照片原理與製作(Lenticular 立體照片)”。

[5] A. Criminisi, “Accurate Visual Metrology from Single and Multiple Uncalibrated Images,” Springer-Verlag London Ltd, July 2001.

[9] Heikkilä, J. and O. Silvén, “A real-time system for monitoring of cyclists and pedestrians,” in Proc. 2nd IEEE Workshop on Visual Surveillance, Fort Collins, CO, pp. 74-81, Jun. 26, 1999.

[11] Wren, C. R., A. Azarbayejani, T. Darrell, and A.P. Pentland, “Pfinder: real-time tracking of the human body,” IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 780-785, July 1997.

[12] S. Battiato, A. Capra, S. Curti and M. La Cascia, “3D Stereoscopic Image Pairs by Depth-Map Generation,” 3dpvt, Second International Symposium on 3D Data Processing, Visualization and Transmission (3DPVT'04), pp. 124-131, 2004.