以動量與特徵點為基礎的動態修補演算法

The Motion Inpainting Based on Motion Vectors and Feature Points

蔡程緯(Joseph C. Tsai)

指導教授 ： 顏淑惠

淡江大學/工學院/資訊工程學系博士班/博士(2013年)

https://doi.org/10.6846/TKU.2013.00203

摘要

圖像以及影片修補的技術已經被很廣泛的應用在日常生活中。在過去幾年中，影片修補可以針對攝影機無移動、有移動的幾乎靜止的背景進行物件的取出。然而，要從動態的背景(如煙霧、火焰以及河流)移除物件則是相當困難的研究。利用現有的影像修補演算法進行處理的話，往往會導致動態結構不連續的問題產生。因此在本研究中，我提出一個全新的修補演算法來解決動態結構不連續的問題。我使用一套不同於以往修補演算法的搜尋區塊的方法，結合邊緣、色彩以及動量的資訊進行區塊的尋找，再透過找出最小能量的隙縫進行區塊影片的時間延長，藉此將找出的區塊時間可以與原始影像相同，最後再利用圖片切割以及泊松方程進行區塊的貼入。除了提出這個演算法之外，我還提出一個方法進行修補結果的判斷，讓使用者可以知道修補的效果。我的這個技術可以利用在一些特效的製作以及影片的後置。

關鍵字

影片修補 ； 影片製作 ； 動作分析 ； 動態修補

並列摘要

Image and video inpainting technologies were studied in the literature. In the past few years, video inpainting methods remove objects from stationary or non-station videos, with mostly static backgrounds. However, to remove objects in a dynamic background, such as fire or smoke scene, most video inpainting algorithms result in a discontinuous visual effect. Although there are several technologies that can be used to generate dynamic textures, there still exists problems for inpainting, such as bad motion continuity due to improper color or motion with respect to the original video. We propose a novel inpainting algorithm to solve the motion textures problem, called motion inpainting. A few steps are introduced in the algorithm, including searching for motion patches from different time slots, extending motion streams, and motion patch blending. We also propose a mechanism to evaluate motion coherence in our experiments. The algorithm is generic and can be used in special effect applications.

並列關鍵字

Video Inpainting ； Video Production ； Motion Analysis ； Motion Inpainting

參考文獻

[1] J.K. Aggarwal and Q. Cai, “Human Motion Analysis: A Review.” In: IEEE Nonrigid and Articulated Motion Workshop, 1997.

[2] S. Avidan and A. Shamir, “Seam Carving for Content-Aware Image Resizing,” In ACM Trans. Graph. Vol. 26( 3), Article 10, July 2007.

[3] J.L. Barron , D.J. Fleet, and S. Beauchemin. "Performance of optical flow techniques." Internation Journal of Computer Vision, Vol. 12, pp. 43-77, 1994.

[6] Y. Boykov, O. Veksler, R. Zabih, "Fast approximate energy minimization via graph cuts," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 23(11), pp. 1222-1239, Nov. 2001.

[7] C.H. Cheung and L.M. Po, "Novel cross-diamond-hexagonal search algorithms for fast block motion estimation," IEEE Transactions on Multimedia, Vol. 7 (1), pp. 16-22, Feb. 2005.