- 學位論文
頭戴式虛擬實境中之光場技術應用
Capitalizing Light-Field Technology in Head-Mounted Virtual Reality
摘要
擴增和虛擬實境（AR / VR）在近年來蔚為風行，而隨著頭戴顯示器的普及使用，它提供了使用者比傳統平面顯示器更加身臨其境的體驗。儘管如此，為了提供更高品質的觀看體驗，研究人員致力於建立一個能夠捕獲更多空間信息的環境。其中，光場技術能夠收集空間中的所有信息，具有很大的發展潛力。在本論文中，我們研究了AR / VR中光場技術應用的兩個發展方向。首先，在微透鏡相機系統中，我們設計了一套自動聚焦VR系統，能夠根據使用者的注視位置自動對場景重新聚焦，並在優化層面設計了2種方法來大幅減少重新聚焦的計算時間。而在相機陣列系統中，我們開發了一套3DoF+ VR系統、並同時設計了一套新的視圖選擇算法，該算法能有效利用場景中的資訊（包刮視圖覆蓋區域、物體遮擋等）來節省視圖合成需要的頻寬及運算量。最後，我們收集了以客觀和主觀角度執行的實驗結果，以評估系統效能。結果表明，對於自動聚焦VR系統，我們的優化將重新聚焦的時間縮短了近319倍，並且與基準系統相比，我們系統的主觀平均意見分數（MOS）高出了19％。而對於視圖選擇算法，我們提出的算法可以得到高達99.67％的平均覆蓋率，只比最優解低了0.1％，而同時我們的計算時間比最優解快了近18倍。
並列摘要
Augmented and Virtual Reality (AR/VR) has become more popular over the years. It delivers a more immersive experience than using the traditional planar monitor with the head-mounted display (HMD). Still, to increase the Quality of Experience (QoE), researchers dedicate to building a better environment with more captured space information. With the capability to retrieve all light information in the space, the light field technology (LF) has excellent potential for the future development of AR/VR technology. In this paper, we study and research two possible directions of LF applications in AR/VR. In the microlens camera system, we design and implement a head-mounted VR system that enables the auto scene refocusing based on the user’s eye gaze. To optimize the latency of the refocusing process, we design two optimization methods that significantly reduce the execution time. In the camera array system, we develop a 3DoF+ VR environment and create a novel view selection algorithm, which can exploit the 3D space information (view scene coverage, object occlusion) of the scene to save both the bandwidth and the computation of view synthesis process. Finally, we hold experiments in both objective and subjective perspectives to evaluate the performance of the systems. The results show that, for the auto-refocus VR system, our optimization methods reduce the refocusing time by up to 319 times and increase the subjective Mean Opinion Score (MOS) by 19% compared to the baseline system. As for the view selection algorithm, our proposed algorithm leads to 99.67% of average synthesis result coverage, which is only 0.1% lower than the optimal solution. However, at the same time, our execution time is about 18 times faster than the optimal solution.
參考文獻
延伸閱讀
- 陳博淵（2020）。使用頭戴式虛擬實境裝置對於視覺表現影響〔碩士論文，國立臺灣大學〕。華藝線上圖書館。https://doi.org/10.6342/NTU202003352
- 呂洽毅、王照明、宋恆（2022）。AR face tracking與虛擬穿戴之研究。屏科大研發專刊，()，15-15。https://www.airitilibrary.com/Article/Detail?DocID=P20110422001-N202304140003-00041
- 蘇慧生（2017）。虛擬實境眼動儀系統研發〔碩士論文，國立臺灣師範大學〕。華藝線上圖書館。https://doi.org/10.6345/NTNU202202131
- 陳信璋（2012）。利用紅外線頭部偵測增強虛擬實境立體效果之研究〔碩士論文，國立臺中科技大學〕。華藝線上圖書館。https://doi.org/10.6826/NUTC.2012.00035
- Lo, W. C. (2018). Edge-Assisted 360-degree Video Streaming for Head-Mounted Virtual Reality [master's thesis, National Tsing Hua University]. Airiti Library. https://www.airitilibrary.com/Article/Detail?DocID=U0016-1803201914472888