透過您的圖書館登入
IP:3.238.62.119
  • 學位論文

基於全景接圖導引以維持時軸一致性之視訊畫面濃縮技術

Maintaining Temporal Coherence in Video Retargeting Using Mosaic-Guided Scaling

指導教授 : 林嘉文

摘要


隨著科技的發展,影像/視訊內容的分享越來越普及,許多人喜歡將生活周遭發生的事物透過行動裝置,例如:手機、PDA、…等,立即分享給親朋好友。但是受限於行動裝置螢幕大小的限制,我們必須對於這些影像/視訊進行畫面濃縮處理才能在這些行動裝置上進行播放。但無可避免的這個過程會造成資訊上的損失。近年來已經有不少研究課題討論如何實現基於內容為主的影像/視訊畫面濃縮,目的是希望畫面經過濃縮之後能盡量維持畫面中人眼感興趣的區域,並且縮小或裁切掉人眼較不感興趣的區域,使得濃縮後的影像/視訊能呈現原始影像/視訊所要分享的訊息。然而,對於濃縮後的視訊如何確保畫面之間在空間軸上以及時軸上的一致性將會是影響視訊品質的關鍵。目前現存的方法對於同時包含有背景鏡頭移動與物體移動的影片很難在畫面濃縮後保持在時軸上的一致性。因此這裡我們提出了一個新的視訊濃縮方法,利用全景接圖導引的方式去決定每一個相對應區域的縮放比例,以確保畫面之間在時軸上的一致性。我們提出的方法先將影片中屬於同一個場景的每一張畫面接合產生一張全景圖,並根據全景圖產生一張全域縮放圖,接著每一張畫面參考全域縮放圖上的資訊與提出的空間軸上限制做最佳化處理,最後得到每一張畫面個別的局部縮放圖和濃縮後的畫面。實驗的結果顯示我們提出的視訊濃縮方法可以有效維持濃縮後的視訊畫面在時軸上的一致性,甚至對於包含有背景鏡頭移動與物體移動的影片也能有不錯的效果。

並列摘要


Video retargeting from a full-resolution video to a lower-resolution display will inevitably cause information loss. Content-aware video retargeting techniques have been studied to avoid critical visual information loss while retargeting a video. Maintaining the spatio-temporal coherence of a retargeted video is very critical on visual quality. Camera motions and object motions, however, usually make it difficult to maintain temporal coherence with existing video retargeting schemes. In this thesis, we propose the use of a panoramic mosaic to guide the scaling of corresponding regions of video frames in a video shot to ensure good temporal coherence. In the proposed method, after aligning video frames in a shot to a panoramic mosaic constructed for the shot, a global scaling map for these frames is derived from the panoramic mosaic. Subsequently, the local scaling maps of individual frames are derived from the global map and is further refined according to spatial coherence constraints. Our experimental results show that the proposed method can effectively maintain temporal coherence so as to achieve good visual quality even a video contains camera motions and object motions.

參考文獻


[1] S. Avidan and A. Shamir, “Seam carving for content-aware image resizing,” ACM Trans. Graphics, vol. 26, no. 3, pp. 16, 2007.
[2] C.-K. Chiang, S.-F. Wang, Y.-L. Chen and S.-H. Lai, “Fast JND-based video carving with GPU acceleration for real-time video retargeting,” IEEE Trans. Circuits Syst. Video Technol, vol. 19, no. 11, pp. 15881597, Nov. 2009.
[3] M. A. Fischler and R. C. Bolles, “Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography,” ACM Commun., vol. 24, no. 6, pp. 381395, June 1981.
[4] Y. Guo, F. Liu, J. Shi, Z.-H. Zhou, and M. Gleicher, “Image retargeting using mesh parametrization,” IEEE Trans. Multimedia, vol. 11, no. 5, pp. 856867, Aug. 2009.
[5] D. Han, X. Wu and M. Sonka, “Optimal multiple surfaces searching for video/image resizing - a graph-theoretic approach,” in Proc. IEEE Int. Conf. Comput. Vis., Sept. Oct. 2009, Kyoto, Japan.

被引用紀錄


夏佑全(2014)。運用即時反饋系統於醫療資訊倫理課程之教學成效及滿意度〔碩士論文,中山醫學大學〕。華藝線上圖書館。https://doi.org/10.6834%2fCSMU.2014.00081
呂淑媛(2013)。模糊德菲法與層級分析法在國中資優生 研究作品評量指標建構之應用〔博士論文,國立高雄師範大學〕。華藝線上圖書館。https://doi.org/10.6817%2fNKNU.2013.00028

延伸閱讀