結合擴增虛擬實境與即時影像辨識之工程應用---以鋼橋鏽蝕辨識為例

Combining AR/VR and Real-Time Image Recognition for Engineering Applications – Taking Steel Bridge Rust Recognition for Example

白博升(Bo-Sheng Bai)

指導教授 ： 陳柏翰

國立臺灣大學/工學院/土木工程學研究所/碩士(2017年)

https://doi.org/10.6342/NTU201701934

摘要

近年來，擴增實境(Augmented Reality, AR)與虛擬實境(Virtual Reality, VR)的技術逐漸成熟，市面上越來越多商業化的相關設備，例如：Microsoft HoloLens (AR)與HTC Vive (VR)。此類頭戴式顯示器(Head-Mounted Display, HMD) 能提供使用者良好的沉浸式體驗，使數位資訊有機會以更符合資料視覺化效益的方式呈現。

由於台灣的氣候普遍濕熱，鋼結構鏽蝕成為一種常見的現象。因此本研究決定以「輔助鋼橋樑鏽蝕檢測」為目標，結合即時影像辨識(Real-Time Image Recognition)與AR/VR開發一套示範系統，包含創新的鏽蝕辨識演算法及容易擴充的虛擬框架，作為探討以上技術導入土木領域的案例。

關鍵字

擴增實境(Augmented Reality, AR) ； 虛擬實境(Virtual Reality, VR) ； 即時影像辨識(Real-Time Image Recognition) ； 頭戴式顯示器(Head-Mounted Display, HMD)

並列摘要

Augmented Reality (AR) & Virtual Reality (VR) is becoming further mature in recent years; there is a lot of commercialized equipment in the market, such as Microsoft HoloLens (AR), HTC Vive (VR) and so on. This kind of Head-Mounted Display (HMD) could provide user a very good immersive experience, and make it more possible to display the digital information in a better data visualizing way.

Because the weather in Taiwan is usually hot and wet, steel getting rust is a common phenomenon. Thus, this research decided to choose “Helping Rust Inspection of Steel Bridge” as target; combined Real-Time Image Recognition with AR/VR to develop a demo system, which contains a new algorithm for rust recognition & an easy-edit virtual frame; as an example to discuss the influence when those technologies mentioned above are brought into Civil Engineering.

並列關鍵字

Augmented Reality (AR) ； Virtual Reality (VR) ； Real-Time Image Recognition ； Head-Mounted Display (HMD)

參考文獻

[5] 楊雅晴，「運用智慧型彩色影像辨識於鋼橋生鏽檢測」，國立臺灣大學工學院土木工程學研究所碩士論文，2008。

[7] 尹昱翰，「鋼構件鏽蝕影片運用雲端辨識系統之初步開發」，國立臺灣大學工學院土木工程學研究所碩士論文，2014。

[9] 劉韋村，「以手持裝置進行鋼材鏽蝕即時影像辨識之系統開發」，國立臺灣大學工學院土木工程學研究所碩士論文，2016。

[10] Heng-Kuang Shen, Po-Han Chen, and Luh-Maan Chang, "Automated Steel Bridge Coating Rust Defect Recognition Method Based on Color and Texture Feature", Automation in Construction, Vol.4, pp.338-356, 2013.

[11] Heng-Kuang Shen, Po-Han Chen, and Luh-Maan Chang, "Support-Vector-Machine-Based Method for Automated Steel Bridge Rust Assessment", Automation in Construction, Vol.23, pp.9-19, 2012.