結合多重觸覺回饋於人機互動之研究-應用於沉浸式體驗與教學輔具設計

The Study by Applying Multiple Haptic Feedback for Human–Computer Interaction – Applications of Immersive Experience and Teaching Aid Design

柯勝富(Sheng-Fu Ko)

指導教授 ： 周建興

淡江大學/工學院/電機工程學系碩士班/碩士(2018年)

https://doi.org/10.6846/TKU.2018.00586

摘要

本論文結合多重觸覺回饋於人機互動領域之中，並應用於沉浸式體驗與教學輔具設計。此研究分為兩大主題，增強沉浸式體驗與教學輔具設計，前者包含AoEs與4D電影院，後者則為「可編程之觸覺回饋模組」快速成型設計系統。其中AoEs為增強傳送門沉浸式體驗而融合多重觸覺回饋，透過多種回饋裝置的結合，模擬出各式自然環境的感受；4D電影院結合「大型裝置用之可編程之觸覺回饋模組」和Google Cloud Vision，即時反應電影場景的環境變化，給予在VR虛擬電影院中的使用者，適當的觸覺回饋感受；而最後者則為增強Haptic Maker對使用者的易用性，進一步優化使用者介面，並解決軟硬體銜接、需相關知識背景的問題，讓使用者把更多的心力，專注在互動內容與裝置的設計開發上，幫助快速開發觸覺回饋裝置的目的。

關鍵字

人機互動 ； 觸覺回饋 ； VR沉浸式環境 ； 互動裝置開發

並列摘要

In this thesis, we utilize multiple haptic feedback in the field of human-computer interaction, and applying to immersive experience and teaching aids. This thesis consists of two parts, enhancing immersive experience and teaching aids. To enhance the user experience, two application, namely as AoEs and 4D theater are developed.
In this study, we design AoEs to provide multiple haptic feedback in order to enhance teleportation experience in immersive environment. By combining different haptic devices, AoEs can simulate a variety of nature environments. In addition, we propose an application, 4D theater, by applying the haptic case and Google Image Content Analysis system, the 4D theater application can real-time detect Environmental changes in movie scene and switch haptic modules to simulate corresponding haptic feedback for user in virtual reality.
To help designers to develop the interactive devices, we propose a rapid prototype including a haptic controller and its operation system. The proposed rapid prototype optimizes user interface for the purpose of strengthening ease of use for Haptic Maker, and resolves the issue about hardware-software integration, a lot of time to making haptic prototype, and needing much background related knowledge. It lets designer more intently focus on development of interactive content and haptic device, and helps designer reduce time to make haptic devices.

並列關鍵字

Human-Computer Interaction ； Haptic Feedback ； Immersive environment ； Interactive Development

參考文獻

[1] B. Banter, “Enabling Technology: Touch Screens and Touch Surfaces are Enriched by Haptic Force-Feedback,“ InformationDisplay, vol. 26, no. 3, 2010, pp. 26–30.

[2]WAVE NG [online] Available:https://www.mimbus.com/en/portfolio/wave-ng-en/

[3]Haruna Fushimi, Daiya Kato, Youichi Kamiyama, Kazuya Yanagihara, Kouta Minamizawa, Kai Kunze, “atmoSphere: designing cross-modal music experiences using spatial audio with haptic feedback”, Proc ACM SIGGRAPH 2017 Emerging Technologies (SIGGRAPH 17), Los Angeles, CA, July 30 - August 03, 2017.

[4]Tomoya Sasaki, MHD Yamen Saraiji, Charith Lasantha Fernando, Kouta Minamizawa, Masahiko Inami, “MetaLimbs: metamorphosis for multiple arms interaction using artificial limbs”, Proc ACM SIGGRAPH 2017 Emerging Technologies (SIGGRAPH 17), Los Angeles, CA, July 30 – August 03, 2017.

[5]Teslasuit [online] Available: https://teslasuit.io/