利用第一人稱視覺之駕駛視角偵測與估測技術並用於駕駛輔助系統

Viewing Angle Detection and Estimation Systems for Driving Assistance using First-Person-Vision

劉光宇(Kuang-Yu Liu)

指導教授 ： 黃仲陵 ； 林嘉文

國立清華大學/電機資訊學院/電機工程學系/碩士(2013年)

https://doi.org/10.6843/NTHU.2013.00068

摘要

行車中，駕駛者的缺乏專注力往往是造成行車事故發生的原因，本論文的目的在建立一套駕駛者輔助系統，此系統可應用於智慧型車輛，來避免由於駕駛者的不當駕駛造成的事故發生。本篇論文使用第一人稱視覺架構，有別於傳統固定式攝影機的環境，是由使用者配戴可攜式攝影機直接取得前方影像，代表使用者眼睛所觀察到的。本論文共有兩個主要的技術：車內外視角偵測及視角角度估測。在第一項技術，我們利用了“bag of words”影像分類的方法，事先蒐集資料庫並應用FAST+BRIEF的特徵萃取方法。之後我們利用此方法將輸入影像轉換成特徵向量，將此利用SVM分類器來偵測輸入影像是車內或車外，進而辨別駕駛者目前的專注程度。在第二項技術，我們額外架設一台行車紀錄器來擷取車輛前方的影像並且作為視角角度估測的參考座標軸。透過雙攝影機的影像特徵比對方法，來估測兩台攝影機的世界座標運動轉換關係，進而估測駕駛者目前的視角方向。本論文實驗結果顯示，我們可以達到即時的估測出駕駛者的視角方向，以及在駕駛者視角車內影像偵測也有良好的準確程度。

關鍵字

駕駛視角 ； 第一人稱視覺 ； 駕駛輔助

並列摘要

This thesis proposes an intelligent vehicle system to identify the driver improper driving behavior using the so-called “first-person vision” (FPV) technology. Different from conventional computer vision, FPV is based on the person wearing a goggles camera representing the subject vision. There are two technologies proposed in this thesis: vehicle exterior/interior view detection and driver viewing angle estimation. For the first method, we use “bag of words” image classification approach by applying FAST+BRIEF feature descriptor in the dataset collected in advance. Then, we establish the first-person vision “vocabulary dictionary”, encoding an input image into a feature vector. Finally, we apply SVM classifier to detect whether the input image is from the inside of a vehicle, and further identifying the driver current attention. For the second method, we install an extra vehicle-mounted camera to record the image in front of the vehicle and to deem it as world coordinate reference for viewing angle estimation. Then, we find the relationship between the world and first-person-vision camera coordinate. Finally, we may further estimate the viewing direction of driver.

並列關鍵字

viewing angle ； gaze direction ； first-person-vision ； driver assistance

參考文獻

[1] M. Miyaji, H. Kawanaka and K. Oguri, "Driver's cognitive distraction detection using physiological features by the adaboost," in ITSC, St. Louis, MO, 2009.

[2] E. Murphy-Chutorian, A. Doshi and M. Trivedi, "Head Pose Estimation for Driver Assistance Systems: A Robust Algorithm and Experimental Evaluation," in ITSC, Seattle, WA, 2007.

[4] T. Kanade and M. Hebert, "First-Person Vision," Proceedings of the IEEE, vol. 100, no. 8, pp. 2442 - 2453, 2012.

[5] Y. Liang, M. Reyes and J. Lee, "Real-Time Detection of Driver Cognitive Distraction Using Support Vector Machines," Intelligent Transportation Systems, IEEE Transactions on, vol. 8, no. 2, pp. 340 - 350, 6 2007.

[6] D. Galvez-López and J. Tardos, "Bags of Binary Words for Fast Place Recognition in Image Sequences," Robotics, IEEE Transactions on, vol. 28, no. 5, pp. 1188 - 1197, 10 2012.