探索觸覺技術以增強虛擬實境中之沉浸式體驗

Exploring Haptic Techniques for Enhancing Immersive Experience in Virtual Reality

韓秉軒(Ping-Hsuan Han)

指導教授 ： 洪一平

國立臺灣大學/電機資訊學院/資訊網路與多媒體研究所/博士(2019年)

https://doi.org/10.6342/NTU201900596

摘要

隨著頭戴式顯示器（HMD）在虛擬實境（VR）領域中的進步，VR開發者能夠為各種領域產生不同的應用，如教育、訓練、虛擬旅遊、娛樂等。當使用者沉浸在虛擬世界時，雖然藉由VR-HMD使用者可以獲得視覺與聽覺上的回饋，但卻無法感受到其他感官上的回饋，這使得現實世界和虛擬世界之間仍然存在著一些差異。為了提供更好的使用者體驗，利用觸覺回饋技術是一種最直接的方法來增強沉浸式體驗，而藉由高沉浸感的VR體驗，能帶給VR應用有更好的表現。然而觸覺體驗的設計並不像我們想像的那麼容易，不同的觸覺刺激需要利用不同技術來重現。在虛擬世界中重建所有觸覺刺激是昂貴且耗電的，且在不同應用中不見得需要模擬所有的觸覺刺激。這不僅涉及到技術問題，也需要更深入地了解人類的感知能力，進而能最大限度地降低成本並專注於應用上的需求。在本論文中，我們的研究目標是藉由觸覺技術以增強身臨其境的沉浸式體驗，而這些具有不同潛力及優使性的觸覺技術，能發揮在不同VR應用當中。透過深入了解人類的觸覺及認知，我們可以為VR應用開發出合適的混合式觸覺系統。本研究提出了四種潛在的技術來增強沉浸式體驗，這之中包含了混合式觸覺系統的設計考量、設計準則及系統原型。藉由這些觸覺技術，使用者可以在虛擬實境中同時獲得手部及上半身的觸覺體驗，並與真實的椅子互動。本研究之成果不僅能益於為混合式觸覺系統之發展，亦助於未來的互動設計師和觸覺設計師能通過觸覺技術設計出更好的沉浸式體驗。

關鍵字

觸覺技術 ； 混合式觸覺 ； 多樣化觸覺 ； 沉浸式體驗 ； 虛擬實境

並列摘要

With the advances of head-mounted displays (HMD) for immersive virtual reality (VR), VR designers are able to produce VR application for many purposes such as education, virtual touring, games, etc. Although the users can perceive visual and auditory feedback with modern VR-HMD, the other human senses are missing when the user immersed in the virtual world. This leads the users to recognize that there is still a difference between the real world and the virtual world. To provide a better user experience, adding tactile sensation is a useful approach that can directly enhance the immersive experience, which is one of the human sense that influenced human perception. Additionally, with higher immersion, the VR application could have better performance. However, designing the haptics experience is not as easy as we think. Different tactile sensation needs several ways to reproduce. To recreate all of the tactile sensations in the virtual world is expensive and power consuming. Besides, we may not need all of it in an application. It is not only about the technical issue but also required to understand human perception, so we can minimize the cost and focus on the application needs. In this dissertation, we aim to enhance the immersive experience via haptic techniques. Those haptic techniques are potential and have different utilities for VR applications. By understanding the tactile sensations and human perception, we can develop a hybrid-haptics system for VR applications. We propose four kinds of potential techniques for enhancing the immersive experience, which contributes the design consideration, guidelines and prototype systems for the addressed hybrid-haptics system. With our haptic techniques, the users can perceive partial body and upper body experience simultaneously, and seamless interaction with a physical chair. Our research results and outcome not only benefit the hybrid-haptics system but also assist future designers and hapticans to design better immersive experience via haptic techniques.

並列關鍵字

Haptic Technique ； Hybrid-Haptic ； Multiple Tactile Sensation ； Immersive Experience ； Virtual Reality

參考文獻

Azmandian, M., Hancock, M., Benko, H., Ofek, E., & Wilson, A. D. (2016, May). Haptic retargeting: Dynamic repurposing of passive haptics for enhanced virtual reality experiences. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (pp. 1968-1979). ACM.

Benko, H., Holz, C., Sinclair, M., & Ofek, E. (2016, October). NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (pp. 717-728). ACM.

Biocca, F., & Delaney, B. (1995). Immersive virtual reality technology. Communication in the age of virtual reality, 15, 32.

Cardin, S., Thalmann, D., & Vexo, F. (2007). Head mounted wind. In proceeding of the 20th annual conference on Computer Animation and Social Agents (CASA2007) (No. VRLAB-CONF-2007-136, pp. 101-108).

Chen, Y. S., Han, P. H., Hsiao, J. C., Lee, K. C., Hsieh, C. E., Lu, K. Y., ... & Hung, Y. P. (2016, October). SoEs: Attachable Augmented Haptic on Gaming Controller for Immersive Interaction. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (pp. 71-72). ACM.