具有頻寬適應功能之可調式多視角視訊串流系統

因應高畫質2D視訊、3D視訊等影像資料量的大幅提升，因此傳送影像資料所需之頻寬也必須相應增加。然而頻寬的變化、影像資料量的變化，會對傳輸造成影響。當頻寬不足時，視訊無法即時傳輸到客戶端，會造成畫面的延遲甚至畫面遺失，當頻寬足夠時，若可傳輸的資料量預設值太小，則會造成視訊品質不佳，頻寬使用率下降。H.264/SVC視訊壓縮編解碼格式雖然具有多層編碼的特性，提供空間、時間、品質三種可調式，但其主要只針對單視角影像，若延伸至多視角影像，會有編碼效率、解碼次數、頻寬分配的問題。H.264/MVC視訊壓縮編解碼格式能夠有效壓縮多視角影像，只需一次解碼即可得到所有視角影像，並且提供視角可調式，但是相較於SVC，MVC缺少了空間、時間、品質三種可調式，對於網路頻寬不穩定變動的適應性差。本論文提出之策略，分成可調式多視角影像串流擷取器和頻寬適應策略兩部分。可調式多視角影像串流擷取器使用多視角視訊編碼技術，可以支援單視角、多視角視訊服務，並加入可調式視訊編碼，空間、時間、品質三種可調式概念，增加多視角視訊編碼的頻寬適應性。頻寬適應策略則提高可調式多視角影像串流擷取器之網路頻寬適應性，且有效利用有限的可用頻寬，提供較好的觀看品質。透過實驗證明，當在本論文模擬之頻寬不足的情況下，本論文提出之策略都可以提供90%以上的頻寬使用率，且Ballroom影像平均PSNR為34 dB，Oldtimers影像平均PSNR為34dB。

關鍵字

可調式視訊編碼；多視角視訊編碼；頻寬適應

並列摘要

The amount of data of High-definition 2D video and 3D video are significantly increasing, the bandwidth to transfer video data also have to increase. The changes of bandwidth and video data will effect transmission. When bandwidth is not insufficient, it may result in delay and loss screen because video data can't be immediately sent to the client. When the bandwidth is sufficient, if the default is too small amount of data transferred, it will result in poor video quality and bandwidth utilization decreased. Although H.264/SVC has the characteristics of the multi-layer coding and provides spatial, temporal and quality scalability, it focuses on single view video and has the question of compression ratio, decoding times and bandwidth allocation extended to multi-view video. H.264/MVC compresses multi-view video efficiently, can get all of view video by decoding once, and provides view scalability. Compares with H.264/SVC, H.264/MVC lacks spatial, temporal and quality scalability and has poor adaptability to unstable changes of network bandwidth. The paper proposes scalable multi-view video streaming extractor and bandwidth adaptation strategy. Scalable multi-view video streaming extractor uses multi-view video coding, supports single-view and multi-view video service and joins spatial, temporal and quality scalability to increase the bandwidth adaptability. Bandwidth adaptation strategy improves the bandwidth adaptability of scalable multi-view video streaming extractor, increases bandwidth utilization and provides better viewing quality. Experiments show that, when the bandwidth is insufficient, it provides more than 90% of bandwidth utilization and the average PSNR of Ballroom and Oldtimers are beyond 34dB.

並列關鍵字

H.264/SVC ； H.264/MVC ； bandwidth adaptation

參考文獻

[3] Gurler, C.G. et al., Flexible Transport of 3D Video over Networks, Journal of Proceedings of IEEE, Vol. 99, No. 4, pp. 694 -707, April 2011.

[6] Heiko Schwarz, Detlev Marpe, and Thomas Wiegand, “Overview of the Scalable H.264/MPEG4-AVC Extension”, IEEE International Conference on Image Processing, Atlanta, GA Oct. 2006.

[7] RTP Payload Format for Scalable Video Coding

[8] MVC/SVC Storage Format

[9] A. Vetro, T. Wiegand, and G. Sullivan, “Overview of the stereo and multiview video coding extensions of the H.264/MPEG-4 AVC standard,” Proc. IEEE, vol. 99, no. 4, pp. 694–707, Apr. 2011.

國際替代計量

具有頻寬適應功能之可調式多視角視訊串流系統

未授權

主題瀏覽