廣角行車紀錄器下的影像穩定及光學失真校正

Video Stabilization with Distortion Correction for Wide-angle Lens Dashcam

黃薪元(Hsin-Yuan Huang)

指導教授 ： 賴尚宏

國立清華大學/電機資訊學院/資訊工程學系/碩士(2016年)

摘要

本篇論文提出了一套適用於行車影像的穩定化方法。系統將光學失真納入考量，估測出相機在光學扭曲下的震動軌跡，並以反向校正而得到穩定化的行車影像。
影像穩定在視覺領域中是項日趨重要的技術，用於增強影像品質和去除振動。而在廣角行車紀錄器中，光學失真常會影響震動的估測。本系統首先針對原始影像進行扭曲參數的估測。我們由多張影像估測出影片的扭曲參數，並用除法失真校正模型以做後續的扭曲校正。接著，系統會從校正後的影像中估測光流場以得到各像素的位移向量；再藉由影像間的光流場以及三維運動模型來估測相機的自我運動。將各時刻所估測的震動位移參數，經過移動平均，而取得平順的位移軌跡。最後，穩定化後的位移參數用以合成具有扭曲校正的穩定化影像。在實驗部分，我們使用了合成與實際的行車影像，進行評估。除了視覺觀察之外，我們亦計算了偵間保真度以提供更為客觀的量化標準以作檢視。

關鍵字

影像穩定 ； 光學失真校正 ； 自我運動

並列摘要

In this thesis, we present a novel stabilization system for the videos recorded by dashcams. Our system takes the effects of optical distortion into consideration and attempt to estimate the shaky trajectories under radial distortion. Thus, we can obtain stable videos by removing the jitters and distortion effects.
Video stabilization is a technique to enhance video quality by removing vibration in the videos. In dashcam videos, the optical distortion often interferences the estimation of the camera motions. For the input video, we first estimate the distortion parameters from the video. We estimate the distortion parameters from point correspondences computed from multiple frames in the video. The division model is applied for distortion correction in this work. Then, we estimate the optical flow from consecutive frames in the corrected video. The ego-motion of the camera can be further estimated by fitting the estimated optical flow vectors to the 3D motion model. Then, a filtering procedure, moving average, is applied to the camera motion parameters to obtain a smooth camera trajectory. We use the smoothed parameters to synthesize the stabilized video. In order to justify our stabilization system, we demonstrate the proposed algorithm on synthetic and real-world videos. We also compute the inter-frame fidelity as a quantitative metric for evaluating the video stabilization result.

並列關鍵字

Video Stabilization ； Distortion correction ； Ego motion

參考文獻

[1] L. Alvarez, L. Gomez, J. R. Sendra, “Accurate depth dependent lens distortion models: an application to planar view scenarios,” Journal of Mathematical Imaging and Vision, vol. 39, no. 1, pp. 75-85, January 2011.

[2] D.G. Lowe, “Object recognition from local scale-invariant features,” IEEE International Conference on Computer Vision, vol. 2, pp. 1150-1157, September 2006.

[7] C. Morimoto and R. Chellappa, “Evaluation of image stabilization algorithms,” IEEE International Conference on Acoustics, Speech and Signal Processing, vol. 5, no. 5, pp. 2789-2792, May 1998.

[11] M. Grundmann, V. Kwatra, and I. Essa, “Auto-directed video stabilization with robust l1 optimal camera paths,” Computer Vision and Pattern Recognition, pp.225-232, June 2011.

[12] C. Buehler, M.Bosse, and L. McMillan, “Non-metric image-based rendering for video stabilization,” Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 609-614, December 2001.