影片雜訊的偵測與修補

Video Defect Detection and Inpainting

陳育屏(Yu-Ping Chen)

指導教授 ： 顏淑惠

淡江大學/工學院/資訊工程學系碩士班/碩士(2005年)

https://doi.org/10.6846/TKU.2005.00725

摘要

本篇論文提出一個修補影片的系統，其主要的偵測對象是短暫性出現的雜訊。我們利用以區塊為基礎的移動估計，使用SAD（Sum of Absolute Difference）公式計算移動向量，進而偵測出雜訊。接著再將偵測到的雜訊過濾，最後再利用temporal及spatial的資訊雙重修補。Spatial的修補方法是利用多重解析度影像修補（multi- resolution image inpainting）。
本研究的結果，可以透過我們的偵測與過濾的演算法，成功地將毀損的區域偵測並修補；大部分的雜訊都可以成功的被偵測到，偵測率約為90%；而其修補後的結果也非常平滑、影片瀏覽順暢，視覺效果與原本影片非常相近，實作結果很好。

關鍵字

影片修補 ； 雜訊偵測 ； 移動估計 ； 影像修補

並列摘要

Video inpainting uses spatial-temporal information to repair defects such as spikes and lines on aged films. We propose a series of new algorithms based on adjustable thresholds to repair different varieties of aged films. The main contribution is an automatic spike and dirt detection mechanism. We prove that if appropriate threshold is once decided by the author, almost all damages in an aged video clip can be detected. In addition, the repairing procedure first estimates temporal information and obtain replacement blocks among several frames. Spatial information is then used to repair damages that can not be fixed by temporal information due to fast motion. The results are visually pleasant with most defects removed.

並列關鍵字

Video Inpainting ； Defect Detection ； Motion Estimation ； Image Completion ； Inpainting

參考文獻

[1] Alberto Machì and Fabio Collura, Accurate spatio-temporal restoration of compact single frame defects in aged motion pictures, Proceedings of the 12th International Conference on Image Analysis and Processing, pp.454-459, 17-19 September 2003.

[3] Alberto Machí and Mario Tripiciano, Video shot detection and characterisation in semi-automatic digital video restoration, Proceedings of the 15th International Conference on Pattern Recognition, Vol.1, pp.855-859, 3-7 September 2000.

[4] Bertalmio, M., Vese, L., Sapiro, G., Osher, S., Simultaneous structure and texture image inpainting, Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol.2, pp.II-707-712, 18-20 June 2003.

[6] K. Deergha Rao, M. N. S. Swamy and E. L. Plotkin, Adaptive filtering approaches for colour image and video restoration, IEEE Proc-Vis. Image Signal Process, Vol.150, No.3, pp.168-177, June 2003.

[9] Kokaram, A.C., On missing data treatment for degraded video and film archives: a survey and a new Bayesian approach, IEEE Transactions on Image Processing, Vol.13, Issue.3, pp. 397-415, March 2004.