基於微機電加速度計之機器學習喉部振動語音轉換可行性研究

Feasibility Study of Machine-Learning Based Throat-Vibration-to-Voice Conversion Using MEMS Accelerometers

許哲諭(Che-Yu Hsu)

指導教授 ： 李尉彰

國立臺灣大學/工學院/應用力學研究所/碩士(2023年)

https://doi.org/10.6342/NTU202303603

摘要

利用高規格壓電加速度計，可以很好的接收喉部表面的振動訊號，並且具備很好的環境雜訊免疫力。結合機器學習的語音轉換技術，可以補償喉部振動訊號在高頻訊號調音缺失的問題。為了推進喉部振動麥克風的商業應用普及化，本文針對喉部振動的感測器進行探討，分析不同感測器對於語音訊號的影響，提出運用微機電加速度計來改善原本壓電式體積龐大以及造價昂貴的問題。同時，探討運用傳統的語音增強方法來改善以微機電加速度計為感測基礎的振動訊號，進一步提升語音轉換的品質。

關鍵字

機器學習 ； 語音轉換 ； 喉部振動訊號 ； 微機電加速度計 ； 語音增強

並列摘要

By utilizing high-quality piezoelectric accelerometers, the vibrations on the neck surface can be effectively captured, which is exhibiting the excellent immunity to environmental noise. With machine-learning-based speech conversion techniques, it becomes possible to compensate for the loss of high-frequency components in the vibration signal. To promote the widespread commercial application of neck vibration microphones, this study dedicates to investigate the different sensors' impact on speech signals. And proposes the use of MEMS accelerometers as a replacement for piezoelectric types, in order to address the issues of size and cost. In addition, the study explores the application of conventional speech enhancement methods to improve the vibration signals captured by MEMS accelerometers, for enhancing the quality of speech conversion.

並列關鍵字

Machine learning ； Voice conversion ； Throat vibration signal ； MEMS accelerometer ； Speech enhancement

參考文獻

[1] Wikipedia. "Throat microphone." https://en.wikipedia.org/wiki/Throat_microphone (accessed.

[2] OTTO. OTTO Throat Microphone [Online] Available: https://www.otto-comm.com/products/throatmicrophones/throatmicrophone

[3] IASUS. TEN-4 Throat Mic & Speaker Amplifier Kit [Online] Available: https://shop.iasus-concepts.com/product/ten-4-throat-mic-speaker-amplifier-kit-black/

[4] G. Fant, Acoustic theory of speech production: with calculations based on X-ray studies of Russian articulations (no. 2). Walter de Gruyter, 1971.

[5] G. Fant, "Glottal flow: models and interaction," Journal of Phonetics, vol. 14, no. 3-4, pp. 393-399, 1986.