Virtual Reality即時虛實整合近距離動態物件偵測研究

Study of Real Time Motion Object Detection for Integration of Virtual and Real World in Virtual Reality

蔡緗琳(Hsiang-Lin Tsai)

指導教授 ： 朱中華

國立臺中科技大學/設計學院/多媒體設計系碩士班/碩士(2018年)

摘要

近年來虛擬實境的發展越來越成熟，在現實生活中的應用也越來越多元。本次論文是透過支援Google’s Project Tango的智慧型手機，使用其兩種相機－RGB攝影機、深度攝影機－結合Google’s Project Tango之技術，可以做到的3D即時建模功能，將3D即時建模之場景物件與現實場景物件做虛實整合。本次研究將以深度攝影機捕捉到的場景物件之點雲（Point Clouds）平均深度數據，透過平均深度數據之變化量，來判斷在現實場景裡是否有3D動態物件。當平均深度數據變化量超出所設定門檻值時，則可偵測出3D動態物件，以此作為3D掃描速度調整及VR畫面更新之依據。本論文進行詳細實驗分析及驗證，實驗結果完整分析在虛實整合之物理上誤差。

關鍵字

虛擬實境 ； Project Tango ； Zenfone AR ； 3D即時建模 ； 虛實整合

並列摘要

In recent years, the development of virtual reality has become more mature, and its application in real life has become more diverse. This these is based on an AR smartphone that supports Google’s Project Tango with its two cameras - RGB camera and depth camera, to sense 3D real world. In this study, the average depth data of Point Clouds on the real 3D objects captured by the depth camera is used to determine whether there are 3D dynamic objects in the real scene. When the average depth data change exceeds the threshold of the average depth data, a 3D dynamic object can be detected. This threshold is also adopted to adjust 3D scanning speed and to update VR representation. We conduct detailed experimental analysis and verification, and completely analyze the physical error of the virtual and real integration in this thesis.

並列關鍵字

Virtual reality ； Project Tango ； Zenfone AR ； 3D instant modeling virtual integration

參考文獻

[1] Azmandian, M., Hancock, M., Benko, H., Ofek, E., & Wilson, A. D. (2016). Haptic Retargeting. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI 16. doi:10.1145/2858036.285 8226

[2] Juri, A. A., Arslan, T., Du, Y., & Wang, Z. (2016). Dual scaling and sub-model based PnP algorithm for indoor positioning based on optical sensing using smartphones. 2016 International Conference on Indoor Positioning and Indoor Navigation (IPIN). doi:10.1109/ipin.2016.7743585

[3] Jeon, J., Ji, M., Kim, J., Park, S., & Cho, Y. (2016). Design of positioning DB automatic update method using Google tango tablet for image based localization system. 2016 Eighth International Conference on Ubiquitous and Future Networks (ICUFN). doi:10.1109/icufn.2016.7537112

[4] Jafri, R., Campos, R. L., Ali, S. A., & Arabnia, H. R. (2018). Visual and Infrared Sensor Data-Based Obstacle Detection for the Visually Impaired Using the Google Project Tango Tablet Development Kit and the Unity Engine. IEEE Access, 6, 443-454. doi:10.1109/access.2017.2766579

[5] ASUS. (n.d.). Retrieved from https://www.asus.com/tw/Phone/ZenFone-AR-ZS571KL/gallery/