行走區域標示及危險狀況判別之盲人輔助系統

Walking Area Labeling and Dangerous Situation Detection for Visually Impaired

鄭綱(Cheng, Kang)

指導教授 ： 王聖智

國立交通大學/電機學院/電子工程系所/碩士(2011年)

https://doi.org/10.6842/NCTU.2011.01038

摘要

在本論文中，我們提出一套以視覺為基礎的盲人輔助系統。本系統採用了資料庫為主的架構，首先具有正常視力之輔助者事先於盲人經常行走之區域，建立360度全景之資料庫，並對資料庫圖片事前標籤重要的物體，像是人行道及道路；然後從全景資料庫中尋找與使用者前方視野最相近的區域；接著把此最接近之區域的標籤利用兩張影像之間的對應，產生目前環境的標籤；最後利用推論的標籤來判斷盲人目前的處境是否危險。只要使用者處於有設置資料庫的環境下，本系統能幫助盲人辨識可行走的區域，達成輔助盲人安全行走之目標。

關鍵字

盲人 ； 影像比對 ； 資料庫檢索 ； 特徵擷取

並列摘要

In this thesis, we propose a data-driven system that assists blind people to walk safely on the sidewalk. In our system, an assistant with normal vision is asked to create the database for the places where the blind user usually visits. At each sampling spot of these places, the assistant takes a few photos that cover different viewing directions around the sampling spot to create a panorama image. After the installation of the database, the blind user is equipped a camera while he or she is walking around these places. For each captured image by the camera, the proposed system finds the most similar panoramic part in the database to identify the location and the orientation of blind user. With an image-to-image matching to warp the labels from the matched panoramic part to the captured image, our system can roughly infer the labeling of the contents within the captured image. Finally, based on the inferred labels, our system can identify situations that could be dangerous to the blinds.

並列關鍵字

visually impaired ； image matching ； database retrieval ； feature extraction

參考文獻

[1] D. Dakopoulos, and N. G. Bourbakis, “Wearable Obstacle Avoidance Electronics Travel Aids for Blind: A Survey,” IEEETransaction on Systems,Man, and Cybernetics, Part C: Applications and Reviews, vol. 40, no. 1, pp. 25-35, Jan. 2010.

[2] S. Shoval, J.Borenstein, and Y.Koren, “The Navbelt-A Computerized Travel Aid for the Blind Based on Mobile Robotics Technology,” IEEETransactions on Biomedical Engineering, vol. 45, no. 11, pp. 1376-1386, Nov.1998.

[3] J. Borenstein, and I. Ulrich, “The GuideCane-A Computerized Travel Aid for the Active Guidance of Blind Pedestrians,” in Proc. IEEE International Conference on Roboticsand Automation, vol. 2, Albuquerque, NM, USA, Apr 1997, pp. 1283-1288.

[5] D. Yuan, and R. Manduchi, “A Tool for Range Sensing and Environment Discovery for the Blind,” IEEE Conference on Computer Vision and Pattern RecognitionWorkshop,pp. 39-39, Jun. 2004.

[9] J. Lafferty, A. McCallum, and F. Pereira, “Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data,” in Proc. International Conference on Machine Learning, pp. 282-289, 2001.