以動態畫面省略及可靠移動向量提升框速轉換視訊之畫質

Quality Enhancement of Frame Rate Up-Converted Video by Adaptive Frame Skip and Reliable Motion Extraction

楊雅婷(Ya-Ting Yang)

指導教授 ： 吳家麟

國立臺灣大學/電機資訊學院/資訊工程學研究所/碩士(2005年)

https://doi.org/10.6342/NTU.2005.01149

摘要

在視訊壓縮應用中，常因為頻寬的限制必需對於視訊資料在空間或是時間的解析度上有所犧牲。利用降低框速(frame rate)所節省的資料率(bitrate)來維持在空間解析度上的一定畫質，以便於之後利用影像在時間上的關聯性來重建完整的框速；此種節省資料率(bitrate)的方式遠比保留多張畫質不好的畫框(frame)來得有效率。框速轉換(Frame Rate Up-conversion)的應用不僅適用於視訊會議上的壓縮，同時對於慢動作播放特效的需求或是不同播放規格之間的轉換(ex: NTSC vs. PAL)也大有助益。本篇論文為了提昇生成視訊的畫質，提出了一個完整的實作流程，不僅在解碼器(decoder)端去分析視訊影像之內容，同時在編碼器(encoder)端也根據人類視覺系統(Human Vision System)模型動態調整壓縮張數，以大幅增進框速轉換(Frame Rate Up-conversion)後的整體視訊畫質。

關鍵字

框速轉換 ； 移動補償畫框內插 ； 動態畫面省略

並列摘要

Frame rate up-conversion (FRUC) is a post-processing tool to convert the frame rate from a lower number to a higher one. It is a useful technique for a lot of practical applications, such as display format conversion, low bitrate video coding and slow motion playback. Unlike traditional approaches, such as frame repetition or linear frame interpolation, motion-compensated frame interpolation (MCFI) technique which takes block motion into account is regarded as a more efficient scheme. By considering the deficiencies in previous works, new criteria and coding schemes for improving motion derivation and interpolation processes are suggested. In addition, adaptive frame skip is fulfilled at the encoder side to maximize the power of MCFI in video coding applications so that the quality of interpolated frames is guaranteed. Experimental results show that our proposal indeed enhances the overall quality, both subjectively and objectively, of the frame rate up-converted video sequence.

並列關鍵字

Frame Rate Up-Conversion ； Motion Compensated Frame Interpolation ； Adaptive Frame Skip

參考文獻

[1] S. C. Park, M. K. Park, and M. G. Kang, Super-resolution image reconstruction: a technical overview, IEEE Signal Processing Magazine, vol. 20, pp. 21-36, May 2003.

[4] A. Kaup and T. Aach, “Efficient prediction of uncovered background in interframe coding using spatial extrapolation,” Proc. of IEEE International Conference on Acoustics, Speech, &Signal Processing, vol. 5, pp. 501-504, 1994.

[6] Kunio Kawaguchi. and Sanjit K. Mitra, “Frame rate up conversion considering multiple motion, “Proc. of IEEE International Conference on Image Processing, vol.1, pp. 727-730, 1997.

[7] Byung Tae Choi, Sung-Hee Lee, and Sung-Jea Ko, “New frame rate up-conversion using bi-directional motion estimation,” IEEE Trans. on Consumer Electron., vol. 46, no.3,. pp. 603–609, Aug. 2000.

[8] Kevin Hilman, Hyun Wook Park, and Yongmin Kim, “Using motion-compensated frame-rate conversion for the correction of 3:2 pulldown artifacts in video sequences,” IEEE Trans. on Circuits and System Video Technology, vol.10, No. 6, pp. 869-877, Sep. 2000.