基於Kinect的盲人室內環境防碰撞輔助系統

Indoor Anti-Collision Blind Aid System Based on Kinect Sensor

許伯恩(Brian Hsu)

指導教授 ： 余松年

國立中正大學/工學院/電機工程學系/碩士(2013年)

摘要

盲人因為視力損傷的緣故，對環境的探索遠比健全人士吃力，在生活上往往會遇到許多不便和危險，因此本論文介紹一個基於Kinect影像的室內盲人防碰撞系統，希望透過此系統幫助視障者在室內環境中，可以避開有可能撞上的障礙物。
本系統透過讀取Kinect的深度影像和彩色影像，並且針對深度影像進行影像處理、物件偵測、障礙物辨識，最後將障礙物的距離和方位透過螢幕與振動器提供給使用者。以影像金字塔的方法來進行影像降取樣以提升系統執行效率，並以中值濾波器平滑深度影像。透過區域成長來進行物件偵測以得到候選障礙物，接著以四個原則來過濾候選障礙物，以得到障礙物及其資訊。同時，也在論文中探討區域成長使用在深度影像中的種子數量和擺設位置，以獲得畫面中所有的物件，並分別在簡單場景與複雜場景進行測試，最後以20個種子數量平均擺設在深度影像中有最佳搜尋候選障礙物的結果。
總合來說，本研究提出一套基於Kinect影像的高效能室內盲人防碰撞輔助系統，以每0.3秒左右處理一張影像，並能將所得障礙物方位和距離資訊透過振動器以不同的頻率來提示使用者。
關鍵字: 盲人輔助系統、Kinect Sensor、區域成長

關鍵字

Kinect Sensor ； 盲人輔助系統 ； 區域成長

並列摘要

The visually impaired people usually need to struggle in their daily lives to explore their outside environment. If more information of the environment can be provided in some way with the assistance of recent technology, then they could adapt to the environment more rapidly. This paper presents an anti-collision blind aid system in the indoor environment based on the Kinect sensor. The system aims to assist the visually impaired avoiding form the obstacles in the indoor environments.
The system obtains the environment information by Kinect sensor, which generates the color image and the depth image. With the image downsampling, image processing, object detection, and obstacle detection of the depth image, the user is able to feel the distance and direction of the obstacles by the vibration module. To promote system efficiency, we downsample the image by image pyramid method. After that, we use median filter to eliminate noise and smooth the image. We obtain the obstacle candidate by using region growing in depth image and using four principles to distinguish the obstacles or not. In the thesis, we also study the issue of the number and positions of the seeds in the region growing method in order to obtain all the objects in the depth image. We tested in both simple and complex scenes and determined that using 20 seeds would achieve the best result.
As the result, we developed an efficient indoor anti-collision blind aid system based on Kinect processing speed of obstacle detecting is 0.3 second per frame. By using this system, the visually impaired is able to know the position and the distance of the obstacle through the different vibration frequency form the vibration module.
Key Words:Blind Aid System, Kinect Sensor, Region Growing

並列關鍵字

Region Growing ； Kinect Sensor ； Blind Aid System

參考文獻

[7] 李嘉祥, “針對盲人輔助應用之電腦視覺演算法開發與硬體架構設計”, 國立臺灣大學電機資訊學院電子工程學研究所碩士論文, 2012

[8] 蘇仕瑋, “以Kinect配合智慧型手機實做盲人輔具系統”, 國立成功大學工科科學學系碩士論文, 2013

[1] World Health Organization Website, Visual impairment and blindness, 2012, http://www.who.int/mediacentre/factsheets/fs282/en/

[4] Wannes van der Mark and Dariu M. Gavrila, “Real-Time Dense Stereo for Intelligent Vehicles”, IEEE Transactions on Intelligent Transportation Systems, VOL. 7, NO. 1, MARCH 2006

[6] D T Delpy, M Cope, P van der Zee, S Arridge, S Wray and J Wyatt , “Estimation of optical pathlength through tissue from direct time of flight measurement”, Phys. Med. Biol., Vol. 33, No 12, 1433-1442, 1988