利用先驗資訊和混和時間特徵評估VR動暈症

VR Sickness Assessment with Perception Prior and Hybrid Temporal Features

郭柏辰(Po-Chen Kuo)

指導教授 ： 李明穗

國立臺灣大學/電機資訊學院/資訊網路與多媒體研究所/碩士(2020年)

https://doi.org/10.6342/NTU202003251

摘要

VR sickness是阻礙VR市場發展的障礙之一。因此，VR sickness的客觀指標非常重要，可以避免使用者遭受VR sickness。最近，一些研究利用深度學習方法來預測VR sickness。但是，他們的方法需要昂貴的計算資源，這限制了real-time的應用。在本文中，我們提出了從光流導出的混合時間特徵，即horizontal motion strength、vertical motion strength和motion anisotropy。我們建立新的數據集，其中包含二十部5分鐘長的360度影片。在實驗中，每位受試者每分鐘會回答Discomfort Scores（0-10），並在影片結束時填寫模擬器疾病問卷（SSQ）。最後，我們採用隨機森林模型在數據集上進行訓練。該模型使用當前混合時間特徵和先前時段的混合時間特徵，這使得模型考慮了VR sickness之間的時間依賴性。我們的方法分別在PLCC和SROCC上比state-of-the-art高出2%和4%，並且可以real-time運行。

關鍵字

VR動暈症 ； 數碼動暈症 ； 混合時間特徵 ； 隨機森林 ； 光流法

並列摘要

VR sickness is one of the obstacles hindering the development of the VR market. Therefore, the objective metric of VR sickness is very important that can help the user to avoid suffering VR sickness. Recently, some works utilize deep learning methods to predict VR sickness. However, their methods are computationally expensive which limited applications in real-time tasks. In this paper, hybrid temporal features derived from optical flow are proposed, namely horizontal motion strength, vertical motion strength, and motion anisotropy. We introduce a new dataset that contains twenty 5-minute-long 360-degree videos. In the experiment, each subject answers Discomfort Scores (0-10) every minute and performs the Simulator Sickness Questionnaire (SSQ) scores at the end of the video. Finally, a random forest model is adopted to train on our dataset. The model uses the current hybrid temporal features and the previous time period hybrid temporal features that make the model considers temporal dependency between the degree of VR sickness. This method not only outperformed previous state-of-the-art by 2% on PLCC and 4% on SROCC but also runs in real-time.

並列關鍵字

VR sickness ； cybersickness ； hybrid temporal features ； random forest ； optical flow

參考文獻

J.-Y. Lee, P.-H. Han, L. Tsai, R.-D. Peng, Y.-S. Chen, K.-W. Chen, Y.-P. Hung, “Estimating the Simulator Sickness in Immersive Virtual Reality with Optical Flow Analysis,” in SIGGRAPH Asia 2017 Posters, 2017, doi: 10.1145/3145690.3145697.

H. G. Kim, W. J. Baddar, H. Lim, H. Jeong, and Y. M. Ro, “Measurement of Exceptional Motion in VR Video Contents for VR Sickness Assessment Using Deep Convolutional Autoencoder,” in Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, 2017, doi: 10.1145/3139131.3139137.

S. Lee, S. Kim, H. G. Kim, M. S. Kim, S. Yun, B. Jeong, Y. M. Ro, “Physiological Fusion Net: Quantifying Individual VR Sickness with Content Stimulus and Physiological Response,” in 2019 IEEE International Conference on Image Processing (ICIP), 2019, pp. 440–444, doi: 10.1109/ICIP.2019.8802983.

D. K. Jeong, S. Yoo, and Y. Jang, “VR Sickness Measurement with EEG Using DNN Algorithm,” in Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology, 2018, doi: 10.1145/3281505.3283387.

T. M. Lee, J. C. Yoon, and I. K. Lee, “Motion Sickness Prediction in Stereoscopic Videos using 3D Convolutional Neural Networks,” IEEE Transactions on Visualization and Computer Graphics, 2019, doi: 10.1109/TVCG.2019.2899186.