以頭戴式顯示器內建揚聲器建構3D虛擬音場

Head-mounted display reproduction of 3D acoustic field

賴威廷(Wei-Ting Lai)

指導教授 ： 王昭男

國立臺灣大學/工學院/工程科學及海洋工程學研究所/碩士(2020年)

https://doi.org/10.6342/NTU202003974

摘要

近年來，虛擬實境(VR)技術的進步促進了3D音效技術的發展。然而，頭戴式顯示器必須與耳機搭配使用，而耳機除了配戴不易與衛生問題。為了有效地解決這些問題並且提升用戶體驗，本研究引入了一項將頭戴式顯示器與微型揚聲器結合的新設計，目標為利用此一裝置建構虛擬聽覺空間。為達成此一目標，本研究提出了一個頭戴式顯示器到耳道之間的轉移函數，即虛擬實境相關轉移函數(VR-to-ear-canal transfer function, VRTF)，以建構虛擬聽覺聲場，然後研究了如何利用微型揚聲器播放3D音效。首先，使用有限元素法(FEM)模擬分析頭相關轉移函數(HRTF)的數據庫，並與實驗量測的結果進行比較。接著使用有限元素法模擬分析VRTF，並進行實驗量測，然後與HRTF數據庫結合以實現VR頭戴式顯示器的虛擬聽覺重放技術。最後，使用CAPZ模型估計HRTF與VRTF，以簡化虛擬聽覺重放的訊號處理過程。

關鍵字

頭相關轉移函數 ； 有限元素法 ； 虛擬聽覺重放 ； 虛擬實境 ； 轉移函數

並列摘要

The progress in virtual reality (VR) has enabled further application of three-dimensional (3D) audio technology. However, head-mounted displays must be used with headphones, engendering personal hygiene concerns. To solve these problems and enhance user experience, this study introducess a new design for a head-mounted display equipped with microspeakers for creating a virtual auditory space. To achieve signal processing in VR auditory displays, we derived a VR-to-ear-canal transfer function (VRTF) to create virtual auditory spaces and then investigated how to relay 3D audio between human ears and the microspeakers inside the head-mounted display. First, a head-related transfer function (HRTF) database was calculated using the finite element method (FEM) and compared with the function obtained in experiments. Second, VRTFs were calculated using the FEM, measured in experiments, and combined with the HRTF database to achieve signal processing in VR auditory displays. Finally, the CAPZ model of HRTFs and VRTFs was measured to simplify signal processing in VR auditory displays.

並列關鍵字

HRTFs ； Finite Element Analysis ； Virtual Auditory Display ； Virtual Reality ； Transfer Function

參考文獻

[1] J. Blauert, Spatial hearing: the psychophysics of human sound localization. MIT press, 1997.

[2] S. S. Stevens and E. B. Newman, "The localization of actual sources of sound," The American journal of psychology, vol. 48, no. 2, pp. 297-306, 1936.

[3] F. L. Wightman and D. J. Kistler, "Monaural sound localization revisited," The Journal of the Acoustical Society of America, vol. 101, no. 2, pp. 1050-1063, 1997.

[4] E. A. Shaw and R. Teranishi, "Sound pressure generated in an external‐ear replica and real human ears by a nearby point source," The Journal of the Acoustical Society of America, vol. 44, no. 1, pp. 240-249, 1968.

[5] D. Hammersho/i and H. Mo/ller, "Sound transmission to and within the human ear canal," The Journal of the Acoustical Society of America, vol. 100, no. 1, pp. 408-427, 1996.