以手做為虛擬化身的微型觸覺回饋體驗之研究

Miniature Haptics: Experiencing Haptic Feedback through Hand-based and Embodied Avatars

王柏翔(Bo-Xiang Wang)

指導教授 ： 陳彥仰

國立臺灣大學/電機資訊學院/資訊工程學研究所/碩士(2020年)

https://doi.org/10.6342/NTU202001119

摘要

我們提出 Miniature Haptics，是一個以手作為虛擬化身的觸覺回饋體驗。藉由將觸覺回饋縮小至手部規模，Miniature Haptics 開拓了新的研究領域來探討以往無法實現的觸覺體驗。我們選用手指走路(Finger Walking)做為虛擬化身以及操控方式，首先探索了 Miniature Haptics 的可行性，然後進行人因實驗以了解人如何將全身的骨架模型對應到手上。為了理解 Miniature Haptics 所帶來的體驗，我們開發了一個小型足球觸覺回饋裝置。實驗顯示 Miniature Haptics 顯著地提升體驗的真實性和娛樂性，同時也是使用者最喜歡的體驗 (p < 0.05)。此外，我們也提出了兩種小型的活動平台提供以下的觸覺體驗: (1) 在平台跳躍遊戲裡能夠迅速變更地面的高度，例如遊戲「超級瑪利歐兄弟」，以及 (2) 變更地面的傾斜程度。整體而言，Miniature Haptics 使得以往無法呈現的創新觸覺體驗變得可能。

並列摘要

We present Miniature Haptics, a new approach to providing realistic haptic experiences by applying miniaturized haptic feedback to hand-based, embodied avatars. By shrinking haptics to a much smaller scale, Miniature Haptics enables the exploration of new haptic experiences that are not practical to create at the full, human-body scale. Using Finger Walking in Place (FWIP) as an example avatar embodiment and control method, we first explored the feasibility of Miniature Haptics then conducted a human factors study to understand how people map their full-body skeletal model to their hands. To understand the user experience of Miniature Haptic, we developed a miniature football haptic display, and results from our user study show that Miniature Haptics significantly improved the realism and enjoyment of the experience and is preferred by users (p < 0.05). In addition, we present two miniature motion platforms supporting the haptic experiences of: 1) rapidly changing ground height for platform jumping games such as Super Mario Bros and 2) changing terrain slope. Overall, Miniature Haptics makes it possible to explore novel haptic experiences that have not been practical before.

參考文獻

[1] B. Araujo, R. Jota, V. Perumal, J. X. Yao, K. Singh, and D. Wigdor. Snake charmer: Physically enabling virtual objects. In Proceedings of the TEI’16: Tenth Interna- tional Conference on Tangible, Embedded, and Embodied Interaction, pages 218– 226. ACM, 2016.

[2] M. Botvinick and J. Cohen. Rubber hands ’feel’touch that eyes see. Nature, 391(6669):756, 1998.

[3] Y.-T. Cheng, T. K. Shih, and C.-Y. Lin. Create a puppet play and interative digi- tal models with leap motion. In 2017 10th International Conference on Ubi-media Computing and Workshops (Ubi-Media), pages 1–6. IEEE, 2017.

[4] C. L. Fernando, T. Igarashi, M. Inami, M. Sugimoto, Y. Sugiura, A. I. Withana, and K. Gota. An operating method for a bipedal walking robot for entertainment. In SIGGRAPH ASIA Art Gallery Emerging Technologies, page 79, 2009.

[5] A.-P. Huang, F. Huang, and J.-S. Jhu. Unreal interactive puppet game development using leap motion. In Journal of Physics: Conference Series, volume 1004, page 012025. IOP Publishing, 2018.