Strategic Selections of Temporal and Spatial Error Concealment Methods using Cooperative Game Structure

運用合作賽局結構之時間域及空間域策略性方法選擇之錯誤隱藏

何青龍(Ching-Lung Ho)

指導教授 ： 張隆紋

國立清華大學/電機資訊學院/資訊工程學系/碩士(2011年)

https://doi.org/10.6843/NTHU.2011.00488

摘要

在容易發生錯誤的傳輸環境下，因為雜訊及封包遺失的影響，影像的品質會受到破壞。而因為有越來越多即時影像的應用所需，所以有一些視訊壓縮標準已經可以達成高壓縮率，像是H.264或MPEG4。而這也會造成視訊流對於錯誤的抵抗力變得更脆弱，而且這些錯誤還會傳遞到後續的影像中。為了不增加編碼端的複雜度，錯誤隱藏的技術就被提出來了，它是一個在解碼端作後端處理的概念。它運用了時間或空間域上的資訊來恢復損壞的資料，而在最近幾年當中有越來越多的時間域，空間域或甚至混和型的錯誤隱藏方法被提出來。
我們提出了兩個時間域的錯誤隱藏方法，它們運用了雙向濾波器來恢復遺失的區塊。雙向濾波器主要是用來處理去除雜訊的問題。因此，我們會運用去除雜訊的演算法來解決我們的錯誤隱藏問題。
之後，我們提出一個合作賽局性的錯誤隱藏架構來適應性地選擇適當的演算法去修補錯誤的區塊。藉由合作賽局，我們可以有效地利用時間域和空間域上的資訊來做錯誤隱藏。因此，比起單獨用一種錯誤隱藏的方法來補，我們方法補出來的結果，其視覺品質會比較好。最後，因為在把遺失區塊換成修補過的區塊之後，可能會產生方塊效應，所以我們也有介紹一個去除方塊的結構來偵測和移除方塊效應，以求更好的影像品質。

In the error-prone transmission environment, the quality of a video sequence may be damaged because of noise or packet loss. Moreover, since more and more real time video stream applications are needed, high compression rates of video streams have been reached by some video coding standards such as H.264 or MPEG4. It will make the video stream more vulnerable against stream error, and the error will also propagate to the successive frames. In order not to increase the complexity of the encoder, error concealment techniques were proposed, and it is a post-processing concept on the decoder. It utilizes the temporal or spatial information to recover the damaged data, and more and more temporal, spatial or even hybrid error concealment methods were proposed over the years.
We propose two temporal error concealment methods, which use bilateral filter as a tool to reconstruct the lost macro-block. Bilateral filter is mainly used to deal with de-noising problem. Therefore, we apply the de-noising algorithm to tackle our error concealment problem.
Afterward, we propose a cooperative game theoretic error concealment structure to adaptively select the proper algorithms to reconstruct the error macro-block. By applying the cooperative game theory, we can effectively take advantages of both temporal and spatial information to do error concealment. Therefore, the result using our method can achieve better visual quality compared with using single error concealment method. Finally, because the blocking effect may occur after replacing the missing macro-block with the concealed macro-block; therefore, we also introduce a de-blocking scheme to detect and remove the blocking effect for better image quality.

關鍵字

錯誤隱藏 ； 賽局理論

並列摘要

In the error-prone transmission environment, the quality of a video sequence may be damaged because of noise or packet loss. Moreover, since more and more real time video stream applications are needed, high compression rates of video streams have been reached by some video coding standards such as H.264 or MPEG4. It will make the video stream more vulnerable against stream error, and the error will also propagate to the successive frames. In order not to increase the complexity of the encoder, error concealment techniques were proposed, and it is a post-processing concept on the decoder. It utilizes the temporal or spatial information to recover the damaged data, and more and more temporal, spatial or even hybrid error concealment methods were proposed over the years.
We propose two temporal error concealment methods, which use bilateral filter as a tool to reconstruct the lost macro-block. Bilateral filter is mainly used to deal with de-noising problem. Therefore, we apply the de-noising algorithm to tackle our error concealment problem.
Afterward, we propose a cooperative game theoretic error concealment structure to adaptively select the proper algorithms to reconstruct the error macro-block. By applying the cooperative game theory, we can effectively take advantages of both temporal and spatial information to do error concealment. Therefore, the result using our method can achieve better visual quality compared with using single error concealment method. Finally, because the blocking effect may occur after replacing the missing macro-block with the concealed macro-block; therefore, we also introduce a de-blocking scheme to detect and remove the blocking effect for better image quality

並列關鍵字

error concealment ； game theory

參考文獻

[1] J. Wu, X. Liu, K. Y. Yoo, “A Temporal Error Concealment Method for H.264/AVC Using Motion Vector Recovery,” IEEE Transactions on Consumer Electronics, Vol. 54 , issue.4 , pp. 1880 – 1885, 2008

[2] Xiaoyu Deng, Yi Liu, Chaoqun Hong, Jiajun Bu, Chun Chen“A temporal error concealment algorithm for H.264/AVC based on edge directions” Image Processing (ICIP), pp.941 – 944, 2009

[3] Mingjing Ai,Qixing Jiang, “Weighted Motion Vectors of double Candidate Blocks Based Temporal Error Concealment Method for Video Transmission over Wireless Network”2010 International Conference on Educational and Network Technology (ICENT 2010), pp. 478 – 481, 2010

[4] Tung-Hsing Wu, Guan-Lin Wu,Ching-Yi Chen, Shao-Yi Chien, “Enhanced Temporal Error Concealment Algorithm with Edge-Sensitive Processing Order” IEEE International Symposium on Circuits and Systems, 2008, pp. 3466-3469, 2008.

[5] Xuanguo Wu, Hong Shen, “Block-Based Weighted Pixel-Value Superposition Algorithm for Inter-Frame Error Concealment” Future Computer and Communication (ICFCC), pp. V2-619 - V2-623, 2010