為近距離應用設計之眼球凝視運動之影像穿透式擴增實境裝置

Gaze+ : A Stereoscopic Video See-Through Augmented Reality Device with Vergence Control and Gaze Stabilization for Near-Field Applications

游子杰(Tzu-Chieh Yu)

指導教授 ： 歐陽明

國立臺灣大學/電機資訊學院/資訊工程學研究所/碩士(2016年)

https://doi.org/10.6342/NTU201601092

摘要

這篇碩論實作了Gaze+，一個能夠正確的顯示近距離(小於30公分)虛擬物體的位置、大小以及方向的影像穿透式擴增實境的裝置。我們實作的頭戴式顯示器原型提供了Vergence Control以及Gaze holding兩種眼球運動的模擬。由於人眼的特性，我們需要透過眼球的運動來讓我們注視在物體上，這可以讓人類的視覺有正確的深度視覺。而Gaze+透過實作機械結構來讓相機模擬兩眼運動的效果，讓相機的視線方向可以注視在同一個點上。
我們已經尋找了十位受試者。並且讓他們比較兩種雙眼立體視覺的頭戴式顯示器，有模擬眼球運動以及沒有模擬眼球運動。結果顯示有模擬兩眼球運動的裝置能讓受試者比較容易地在近距離的觀看時產生正確的立體視覺。Gaze+是第一個有模擬眼球運動的影像穿透式擴增實境頭戴式顯示器，而這會讓近距離的擴增實境應用能夠正確的顯示。
我們製作了一個電路板組裝的擴增實境應用。透過在電路板上顯示虛擬的電子零件來引導新手進行電路板的組裝。由於這是一個近距離的擴增實境應用，使用Gaze+的眼球模擬可以讓雙眼相機的視線維持在電路板上，這讓使用者透過頭戴式顯示器觀看電路板時可以有正確的雙眼立體視覺。
Gaze+的Vergence Control系統使用AX-18A高解析度伺服馬達作為眼球轉動的機械結構中心，透過高精確度細微的運動來模擬眼球的轉動，並且使用物體追蹤演算法來模擬眼睛視線注視在一個點的狀況。Gaze holding系統則是選擇使用空拍機在用的兩軸穩定器來改裝，兩軸穩定器的功用可以讓相機的視線維持在同一個方向上，正好具有視線穩定的功能，在加上近年來空拍機的流行，選擇其來使用Gaze+的核心元件可降低實作Gaze+的難度。

關鍵字

擴增實境 ； 影像穿透式 ； 頭戴式顯示器 ； 眼球運動 ； 三軸穩定器

並列摘要

This thesis presents Gaze+, a video see-through Augmented Reality (AR) device that can display close-ranged stereoscopic Mixed Reality, showing real and virtual objects up close (about 30cm from the camera) in their correct positions, scales, and orientations. Our head-mounted display (HMD) prototype offers vergence control and gaze holding. Because humans have two eyes placed side by side, they need to simultaneously rotate and properly converge onto an object of interest. This is important because it allows humans to see properly and have proper depth perception. We made a stereo camera device that can simulate the motion of human eyes so that both eyes are directed towards the same world point.

We had conducted a user study with 10 participants. We had let them compare two kinds of stereo camera AR HMD, one with and one without vergence control. Results show that their eyes can converge better and more accurately when they are observing with Gaze+. Gaze+ is the first video see-through AR HMD that can correct optical vergence for close-ranged Mixed Reality applications.

並列關鍵字

Augmented Reality ； Head-Mounted Display ； Video See-Through ； Vergence Control ； Gaze holding ； Gaze stabilization

參考文獻

[1] DavidJ.Coombs.Real-timegazeholdinginbinocularrobotvision.Technicalreport, Rochester, NY, USA, 1992.

[2] William Steptoe, Simon Julier, and Anthony Steed. Presence and discernability in conventional and non-photorealistic immersive augmented reality. In Mixed and Augmented Reality (ISMAR), 2014 IEEE International Symposium on, pages 213– 218. IEEE, 2014.

[3] Yu-HsuanHuang,Tzu-ChiehYu,Pei-HsuanTsai,Yu-XiangWang,Wan-LingYang, and Ming Ouhyoung. Scope+: a stereoscopic video see-through augmented reality microscope. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, pages 33–34. ACM, 2015.

[4] Andrei Sherstyuk, Arindam Dey, Christian Sandor, et al. Dynamic eye convergence for head-mounted displays improves user performance in virtual environments. In Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, pages 23–30. ACM, 2012.

[5] KurtisPKeller,HenryFuchs,etal.Simulation-baseddesignandrapidprototypingof a parallax-free, orthoscopic video see-through head-mounted display. In Proceedings of the 4th IEEE/ACM International Symposium on Mixed and Augmented Reality, pages 28–31. IEEE Computer Society, 2005.