簡易檢索 / 詳目顯示

研究生: 許之凡
Chih-Fan Hsu
論文名稱: 基於環車鳥瞰影像之自動停車系統
Automatic Parking Based on Bird`s-eye View Image
指導教授: 陳世旺
Chen, Sei-Wang
學位類別: 碩士
Master
系所名稱: 資訊工程學系
Department of Computer Science and Information Engineering
論文出版年: 2010
畢業學年度: 98
語文別: 中文
論文頁數: 122
中文關鍵詞: 鳥瞰影像俯視影像轉換影像接合色彩混合曝光補償扭曲消除攝影機校正暗角效應路徑規劃自動停車非完整系統
英文關鍵詞: Bird`s-eye view image, Top-view transformation, Image registration, Color Blending, Exposure compensation, Radial distortion recovery, Camera calibration, Vignetting effect, Path planning, Automatic parking, Nonholonomic system
論文種類: 學術論文
相關次數: 點閱:340下載:15
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 車輛駕駛輔助系統的主要目的為提升行車駕駛者的安全、效率與舒適。本研究在車輛的周圍裝設攝影機,建立一環車全景鳥瞰影像,如此可以解決車輛四周的盲點區域問題,而本研究利用此種影像從事自動停車的目的。
    本研究使用四個魚眼攝影機,將其架設在車型機器人AmigoBot四周,擷取其四周的影像,並分別對其影像各自執行攝影機的暗角效應消除(vignetting elimination)、魚眼影像的反扭曲(distortion recovery)、俯視影像轉換(top-view image transformation),最後再將俯視影像做影像接合(image registration)與色彩混合(color blending),建立車輛周圍的全景鳥瞰影像。本研究並紀錄了在各影像轉換階段中影像像素位置的對應關係,將其整合成一轉換表,如此將來可以利用查表法(look-up table)來加速鳥瞰影像建立的速度,使之能到達即時轉換的目的。當鳥瞰影像建立出來後,本實驗假設已偵測到車輛周圍停車格位的位置,再實地考察真實車輛的運動行為,使AmigoBot模擬一般車輛的運動行為。再依據台灣現有的三種停車格位(直角停車格位、斜角停車格位、路邊停車格位),各自設計停車的策略,使車型機器人能依策略達到自動停車的目的。實驗顯示,本研究可達成即時建立車輛周圍的鳥瞰影像與各種不同的自動停車策略。

    This article presents an automatic parking system based on a bird`s-eye view image around a vehicle. There are four fisheye cameras mounted around the vehicle for capturing its surrounding images. Cameras are calibrated beforehand. Thereafter, for each input image we apply vignetting elimination, distortion recovery, and top-view transformation to the image. The resultant four images are then registered and blended to arrive at what we call the bird`s-eye view image around the vehicle. The above process is transformed into a table that records all stages of the process. With this table, real-time bird`s-eye view image generation can be achieved simply through looking-up table. We assume here parking spaces have been located based on the bird`s-eye view images. Three kinds of parking spaces, parallel, diagonal, and vertical, are then considered when planning paths for automatic parking. A car-like robot, AmigoBot, has been used to extensively test on bird`s-eye view image generation and automatic parking.

    附表目錄 vii 附圖目錄 viii 第一章 簡介 1-1 1.1 研究動機………………………………………………………………1-1 1.1.1 行車安全方面…………………………………………………………1-2 1.1.2 提升行車效率與提升駕車人的舒適度方面…………………………1-2 1.2 車輛盲點區域…………………………………………………………1-4 1.3 攝影機的選擇…………………………………………………………1-6 1.4 停車格位………………………………………………………………1-8 1.5 文獻探討………………………………………………………………1-10 1.5.1 全景鳥瞰影像與盲點區域偵測………………………………………1-10 1.5.2 車輛的路徑策略………………………………………………………1-17 1.6 文章架構………………………………………………………………1-21 第二章 系統架構 2-1 2.1 系統架構………………………………………………………………2-1 2.2 系統流程圖……………………………………………………………2-2 2.2.1 鳥瞰影像的建立………………………………………………………2-2 2.2.2 路徑規劃以及自動停車………………………………………………2-5 第三章 鳥瞰影像的建立 3-1 3.1 攝影機校正與其參數求取……………………………………………3-3 3.1.1 座標系統………………………………………………………………3-3 3.1.2 參數求取………………………………………………………………3-7 3.2 暗角效應與其參數求取………………………………………………3-9 3.2.1 離軸光照………………………………………………………………3-10 3.2.2 鏡頭內部的排置………………………………………………………3-12 3.3 扭曲校正與其參數求取………………………………………………3-13 3.4 俯視影像轉換與其參數求取…………………………………………3-16 3.5 影像接合與其參數求取………………………………………………3-20 3.6 暗角消除與色彩混合…………………………………………………3-21 3.7 鳥瞰影像轉換表………………………………………………………3-25 第四章 路徑規劃 4-1 4.1 基礎路徑策略…………………………………………………………4-1 4.1.1 最小迴轉半徑與速度表示……………………………………………4-2 4.1.2 車輛橫向移動策略……………………………………………………4-3 4.1.3 車輛原地旋轉策略……………………………………………………4-6 4.2 停車策略………………………………………………………………4-8 4.2.1 直角停車策略…………………………………………………………4-8 4.2.2 路邊停車策略…………………………………………………………4-14 4.2.3 斜角停車策略…………………………………………………………4-18 第五章 路徑規劃以及自動停車 5-1 5.1 實驗場景設計與車型機器人AmigoBot ……………………………5-1 5.1.1 車型機器人AmigoBot ………………………………………………5-1 5.1.2 實驗場景設計…………………………………………………………5-2 5.2 各階段的參數與其結果………………………………………………5-3 5.3 自動停車………………………………………………………………5-12 5.3.1 直角停車………………………………………………………………5-12 5.3.2 路邊停車………………………………………………………………5-24 5.3.3 斜角停車………………………………………………………………5-25 第六章 結論 6-1 6.1 結論……………………………………………………………………6-1 6.2 未來工作………………………………………………………………6-2 附錄A 曝光補償 附-1 附錄B 非完整系統 附-2 附錄C AmigoBot 控制程式碼 附-3 參考著作 參-1

    [Gov 1] http://www.moi.gov.tw/stat/news_content.aspx?sn=3638
    [Gov 2] http://www.stat.gov.tw/mp.asp?mp=4
    [Gov 3] http://www.motc.gov.tw/mocwebGIP/wSite/lp?ctNode=162&CtUnit=94&BaseDSD=16&mp=1
    [Gov 4] http://safety.iot.gov.tw/rule/files/道路交通標誌標線號誌設置規則_修訂版_981208.pdf
    [Gov 5] http://www.motc.gov.tw/motchypage/safe/speed_001_2.htm
    [Gov 6] http://roadweb.cpami.gov.tw/
    [Bertozzi 1998] Massimo Bertozzi, Alberto Broggi, "GOLD: A Parallel Real-Time Stereo Vision System for Generic Obstacle and Lane Detection," IEEE Transactions on Image Processing, vol.7, no. 1, pp.62-81, 1998.
    [Bravo 2001] F. Gomez-Bravo, F. Cuesta, A. Ollero, "Parallel and diagonal parking in nonholonomic autonomous vehicles," vol.14, no.4, pp.419-434, 2001.
    [Claus 2005(1)] D Claus, A.W. Fitzgibbon, "A Plumbline Constraint for the Rational Function Lens Distortion Model," Proceedings of the British Machine Vision, 2005.
    [Claus 2005(2)] D. Claus, A.W.Fitzgibbon, "A rational function lens distortion model for general cameras," In Proc. CVPR, vol. 1, pp.213–219, 2005.
    [Devernay 2000] Frederic Devernay, Olivier Faugeras, "Straight lines have to be straight," Machine Vision and Applications, vol.13, no.1, pp.14-24, 2001.
    [Ehlgen 2007] Ehlgen Tobias, Pajdla Tomas, "Monitoring surrounding areas of truck-trailer combinations," The 5th International Conference on Computer Vision Systems, Bielefeld, Marz. 21-24, 2007.
    [Gandhi 2004] Tarak Gandhi, Mohan Manubhai Trivedi, "Motion Based Vehicle Surround Analysis Using an Omni-Directional Camera," IEEE
    Intelligent Vehicles Symposium, Issue 14-17, pp.560-565, 2004.
    [Gandhi 2006] Tarak Gandhi, Mohan Manubhai Trivedi, "Vehicle Surround Capture Survey of Techniques and a Novel Omni-Video-Based Approach for Dynamic Panoramic Surround Maps," IEEE Transactions on Intelligent Transportation Systems, vol.7, No.3, pp.293-308, September, 2006.
    [Geyer 2001] Christopher Geyer, Kostas Daniilidis, "Catadioptric Projective Geometry," International Journal of Computer Vision, vol.45, no.3, pp.223-243, 2001.
    [Goldman 2005] Dan B Goldman, Jiun-Hung Chen, "Vignette and Exposure Calibration and Compensation," IEEE International Conference on Computer Vision, vol.1, pp.899-906, 2005.
    [Goldman 2010] Dan B Goldman, "Vignette and Exposure Calibration and Compensation," IEEE Transactions on Pattern Analysis and
    Machine Intelligence, 2010.
    [Hartley 2003] Richard Hartley, Andrew Zisserman, "Multiple view geometry in computer vision," Second Edition, pp.33-44, 2003.
    [Ishii 2008] Yohei Ishii, Keisuke Asari, Hitoshi Hongo, Hiroshi Kano, "A Practical Calibration Method for Top View Image Generation," International Conference on Consumer Electronics, pp.1-2, 2008.
    [Jiang 1999] K. Jiang, L. D. Seneviratne, "A SENSOR GUIDED AUTONOMOUS PARKING SYSTEM FOR NONHOLONOMIC MOBILE ROBOTS," IEEE International Conference on Robotics and Automation, vol.1, pp.311-316, 1999.
    [Kang 2000] Sing Bing Kang, Richard Weiss, "Can We Calibrate a Camera Using an Image of a Flat,Textureless Lambertian Surface?," European Conference on Computer Vision, pp.640-653, 2000.
    [Lamiraux 2001] F. Lamiraux, J.-P. Laumond, "Smooth motion planning for car-like vehicles," IEEE Transactions on Robotics and Automation, vol.17, no.4, pp.498-501, 2001.
    [Laumond 1994] Jean-Paul Laumond, Paul E. Jacobs, Michel Taix, Richard M. Murray, "A Motion Planner for Nonholonomic Mobile Robots," IEEE Transactions on Robotics and Automation, vol.10, no.5, pp.577-593, 1994.
    [Li 2003] Tzuu-Hseng S. Li, Shih-Jie Chang, "Autonomous Fuzzy Parking Control of a Car-Like Mobile Robot", IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, vol.33, no.4, pp.451-465, 2003.
    [Liu 2008] Yu-Chih Liu, Kai-Ying Lin, Yong-Sheng Chen, "Bird's-eye view vision system for vehicle surrounding monitoring," Proceedings of the 2nd international conference on Robot vision , pp. 207-217, 2009.
    [Lowe 2004] D. Lowe. "Distinctive image features from scale-invariant keypoints," International Journal of Computer Vision, vol.60, no.2, pp.91–110, 2004.
    [Lowe 2006] M. Brown and D. Lowe, "Automatic Panoramic Image Stitching using Invariant Features," International Journal of Computer Vision, vol.74, no.1, pp.59-73, 2006.
    [Makita 1994] Yuji Makita, Masafumi Hagiwara, Masao Nakagawa, "A Simple Path Planning System Using Fuzzy Rules and a Potential Field," IEEE World Congress on Computational Intelligence, Proceedings of the Third IEEE Conference on Fuzzy Systems, vol.2, pp.994-999, 1994.
    [Mota 2004] S. Mota, E. Ros, E. M. Ortigosa, and F. J. Pelayo, "Bio-inspired motion detection for blind spot overtaking monitor," International Journal of Robotics and Automation—Special Issue of Neuromorphic Systems, vol.19, no.4, pp.2713, 2004.
    [Nieto 2007] Marcos Nieto, Luis Salgado, Fernando Jaureguizar, and Juli’an Cabrera, "Stabilization of Inverse Perspective Mapping Images based on Robust Vanishing Point Estimation," IEEE Intelligent Vehicles Symposium, pp.315-320, 2007.
    [PDC 1] http://big5.ifeng.com/gate/big5/baike.auto.ifeng.com/doc-view-493.html
    [Peng 2008] Gang Peng, Xinhan Huang, Jian Gao, Cheng Li, "Camera Modeling and Distortion Calibration for Mobile Robot Vision," Proceedings of the 7th World Congress on Intelligent Control and Automation, pp.1657-1662, 2008.
    [Toyota 1] http://www.toyota.com.tw/2F_vehicle/vehicle_intro3.asp?CARSID=74
    [Toyota 2] http://www.toyota.com.tw/5F_tech/safety_article1.asp
    [Wang 1992] Juyang Weng, Paul Cohen, Marc Herniou, "Camera Calibration with Distortion Models and Accuracy Evaluation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.14, no.10, pp.695-980, 1992.
    [Zhang 2000] Z. Zhang, "A flexible new technique for camera calibration," IEEE Transactions on Pattern Analysis and Mahine Intelligence, vol.22,no.11, pp.1330-1334, 2000.
    [Zitova 2003] Barbara Zitova`, Jan Flusser, "Image registration methods: a survey," Image and Vision Computing, vol.21, no.11, pp.997-1000, 2003.
    [曲 2007] 曲治宇, "車用全景影像裝置創作與可行性探討," 華梵大學工業設計系, 碩士論文, 2006.
    [陳 2008] Yi-Fu Chen, "A Bird-view Surrounding Monitor System for Parking Assistance," 中央大學資訊工程學系, 碩士論文, 2008.

    下載圖示
    QR CODE