基於深度可調三維模型以產生車輛環周影像之研究

On Generating Vehicle Surrounding Images Based on Depth-Adaptive 3D Model

葉彥廷(Yen-Ting Yeh)

指導教授 ： 洪一平

國立臺灣大學/電機資訊學院/資訊網路與多媒體研究所/碩士(2014年)

https://doi.org/10.6342/NTU.2014.01480

摘要

車輛駕駛人常因為車體本身的視覺盲點而造成交通意外，現有的車輛輔助系統常利用警示燈號或聲響來提供駕駛車輛環周狀況。由於鏡頭的售價漸趨便宜，目前車廠也將攝影機架設於車輛周圍，並將攝取到的影像或是車輛上方的鳥瞰影像顯示於車內，作為安全駕駛輔助視訊系統。相對於固定的鳥瞰視角，我們提出了一使用第三人稱視角的車輛環周監視系統─“天使之眼”。我們接合車輛四周的魚眼攝影機所擷取的影像，將環周影像投影在一混合式3D 模型中，並提供不同視角的影像，使得駕駛者可自由轉換視角。
但因系統未知車輛周圍前景物的深度，在視覺呈現上，會有前景物的影像扭曲或是鬼影的現象產生。所以我們將深度攝影機加裝於汽車上，並透過擷取到的障礙物深度資訊，設計了一個會隨深度資訊不同而調整的3D 投影模型，以解決影像接合處的鬼影問題，並減低車輛周圍物體的影像扭曲。

關鍵字

車輛環周監視系統 ； 視像內插 ； 影像縫合 ； 混合式投影模型 ； 車輛安全空間計算 ； 深度可調三維模型

並列摘要

Driving assistance systems help drivers to avoid car accidents by provid-ing warning signals or visual cues of surrounding situations. Instead of the fixed bird’s-eye view monitoring proposed in many previous works, we de-veloped a real-time vehicle surrounding monitoring system, ”Angel Eye”, that can assist drivers to perceive the vehicle surrounding situations more easily. In our system, four fisheye cameras are mounted around a vehicle. To inte-grate these four fisheye camera views, we firstly use fisheye camera calibra-tion method to dewarp the captured images into perspective projection ones. Then, we calculated the camera intrinsic parameters and homography trans-form matrix to get the camera extrinsic parameters. To stitch these dewarpped images, we projected undistorted images into a 3D hybrid projection model and finally the images of the selected viewpoint are rendered.
However, the unknown position of foreground obstacles would cause some visual noises, like image distortion of objects or ghost effect. So we add depth camera into previous system to obtain the depth information of foreground obstacles. The proposed 3D model can be adjusted based on the distance between vehicle and foreground obstacles. The depth-adaptive model can fa-cilitate the rendering of vehicle surroundings in a more realistic and correct way.

並列關鍵字

vehicle surrounding monitoring ； view interpolation ； image stitch-ing ； hybrid projection model ； free space calculation ； depth-adaptive 3D model

參考文獻

[1] NISSAN

[6] Yu-Chih Liu, Kai-Ying Lin, and Yong-Sheng Chen. Bird’s-Eye View Vision System for Vehicle Surrounding Monitoring. In Proceedings of 2nd International Workshop,

RobVis 2008, volume 4931/2008 of Lecture Notes in Computer Science, pages 207–218. Springer, 2008.

[8] Susumu Kubota, Tsuyoshi Nakano, and Yasukazu Okamoto. A Global Optimization Algorithm for Real-Time On-Board Stereo Obstacle Detection Systems. In 2007 IEEE Intelligent Vehicles Symposium, pages 7–12. IEEE, June 2007.

[10] Hernán Badino, Uwe Franke, and Rudolf Mester. Free space computation using stochastic occupancy grids and dynamic programming. In Proc. International Conference on Computer Vision, Workshop on Dynamical Vision, Rio de Janeiro, Brazil, page 20, 2007.