以雙攝影機為基礎之視訊形變及其在視訊會議之應用

Dual-Camera Based Video Morphing and its Application on Video Conference

王亮凱(Liang-Kai Wang)

指導教授 ： 陳炳宇

共同指導教授 ： 歐陽明

國立臺灣大學/管理學院/資訊管理學研究所/碩士(2006年)

https://doi.org/10.6342/NTU.2006.00805

摘要

在視訊會議中，錯誤的使用者眼神方向的問題一直存在。使用者總是會覺得對方沒在看自己而是在看其他地方。正確的眼神方向可以讓使用者覺得比較自然，進而更專心在彼此的交談中。這篇論文提出了新的一個虛擬視角合成系統： 使用者只要將兩台網路攝影機安置在電腦螢幕的兩旁（左邊與右邊），系統就會合成出一張眼神轉到正前方而且高品質畫面的虛擬影像。在先前其他相關的研究中， 要即時合成出虛擬的視訊影像需要大量的CPU 計算。如果使用者希望享受一個高品質而且即時生成結果的系統， 往往必須求助於專門的硬體設備。本篇論文所提出的方法是基於軟體執行來實現， 而所提出的方法(scanline based matching algorithm)可以讓執行效率媲美硬體加速。為了讓合成出來的虛擬影像看起來更為自然， 我們提出了一個新演算法(modified dynamic programming)。並且對遮蔽問題作了一些改進。論文最後也附上一些實驗結果與數據。

關鍵字

校正注視方向 ； 動態規劃法 ； 掃瞄線影像比對 ； 視訊形變 ； 視訊會議

並列摘要

In recent years, eye contact problem always exists in daily video conferencing. Users will feel more comfortable and pay more attention to the conversation with proper eye contact. This thesis proposes a novel virtual view synthesis system. Given two video streams from two cameras located in either side of the monitor (ex: Left and right), the system synthesizes a high quality view-corrected virtual image. In the previous work, synthesized images take lots of time for CPU computation. Special hardware-support may be the only solution if the application needs to be high quality and real-time. However, the performance of our proposed fast scanline based matching algorithm can reach real-time, comparing to certain conventional matching algorithms. To achieve natural virtual image synthesizing, the modified dynamic programming approach is adopted. Artifacts and occlusion problems are also handled. A number of examples demonstrate the high quality results of the proposed algorithm.

並列關鍵字

eye-gaze correction ； dynamic programming ； scanline based image matching ； video morphing ； video conference

參考文獻

[CCBK06] A. Criminisi, G. Cross, A. Blake, and V. Kolmogorov. Bilayer seg- mentation of live video. IEEE Conference on Computer Vision and Pattern Recognition, pp.53-60, 2006.

[CHRM96] I. J. Cox, S. L. Hingorani, S. B. Rao, and B. M. Maggs. A maxi- mum likelihood stereo algorithm. Computer Vision and Image Un- derstanding, Vol.63, No.3, pp.542-567, 1996.

[CW93] S. E. Chen and L. Williams. View interpolation for image synthesis. SIGGRAPH, pp.279-288, 1993.

[FTV00] A. Fusiello, E. Trucco, and A. Verri. A compact algorithm for recti- fication of stereo pairs. International Journal of Machine Vision and Applications, vol.12, No.1, pp.16-22, 2000.

[GM03] David M. Grayson and Andrew F. Monk. Are you looking at me? eye contact and desktop video conferencing. ACM Transactions on Computer-Human Interaction, Vol.10, No.3, pp.221-243, 2003.