基於標記物擴增實境下的遮擋處理

Occlusion handling on marker-based augmented reality

高梵(Kao Fan)

指導教授 ： 李忠謀

國立臺灣師範大學/理學院/資訊工程學系/碩士(2018年)

https://doi.org/10.6345/THE.NTNU.DCSIE.031.2018.B02

摘要

本研究提出了基於標記物的遮檔處理演算法，藉由深度攝影機取 得真實環境的幾何資訊，以達成對虛擬物件的遮檔處理。現有的遮擋 處理研究中，少有針對處理時間的優化，但在擴增實境應用中，每秒 幀數(Frames per Second，FPS)至少需到達 30FPS，才能提供良好的 使用體驗，因此遮檔處理除了考量畫面的精細程度外，也要考慮處理 時間。本研究提出了針對處理速度優化的演算法，動態地計算需處理 的範圍，並盡量減少需運算的像素數。實驗的部分可以得知，藉由動 態遮檔處理範圍，遮檔處理的運算時間降至原本的四分之一，最終在 RealSense SR 300 上可以達成每秒三十幀的速度，與此相機原生的每秒 幀數相同。
由於本研究無針對原始深度影像進行優化，為確保其可用性，亦測 量原始深度影像中雜訊像素的寬度，從實驗結果得知，在物體距離鏡 頭 50 至 70 公分時，雜訊的像素寬度從 30pixels 逐漸降低至 10pixels， 證明在一定距離使用時，雜訊並不會嚴重地影響遮檔處理的結果。

關鍵字

擴增實境 ； 遮擋問題 ； 深度影像 ； 影像處理

並列摘要

This paper presents a occlusion handling algorithm on marker-based aug- mented reality system, which obtains the geometric information of real envi- ronment by depth camera to achieve occlusion handling of the virtual object. In the existing occlusion handling research, there is less attention to process- ing time, but in augmented reality applications, frames per sescnod(FPS) need to reach at least 30 FPS to provide a good experience.
This paper proposes an algorithm for processing speed o ㄣ timization, which sets range of processing dynamically.According to experiments, the processing time of occlusion processing is reduced by three quarters, and reach 30 FPS as well as FPS of RealSense SR300.
This paper doesn’t refine raw depth image,To ensure its usability, the width of noise pixels in raw depth images is measured,according to the exper- imental results, when the object is 50 to 70 cm away from the lens, the pixel width of the noise is gradually reduced from 30 pixels to 10 pixels, which proves that the noise does not seriously affect the result of the occlusion pro- cessing when used at a certain distance.

並列關鍵字

Augmented Reality ； Occlusion Problem ； Depth Image ； Image Process

參考文獻

Amin, D., & Govilkar, S. (2015). Comparative study of augmented reality sdk’s. Inter- national Journal on Computational Science & Applications, 5(1), 11–26.

Du, C., Chen, Y.-L., Ye, M., & Ren, L. (2016). Edge snapping-based depth enhancement for dynamic occlusion handling in augmented reality. In Mixed and augmented reality (ismar), 2016 ieee international symposium on (pp. 54–62).

Durrant-Whyte, H., & Bailey, T. (2006). Simultaneous localization and mapping: part i. IEEE robotics & automation magazine, 13(2), 99–110.

Gao, X.-S., Hou, X.-R., Tang, J., & Cheng, H.-F. (2003). Complete solution classification for the perspective-three-point problem. IEEE transactions on pattern analysis and machine intelligence, 25(8), 930–943.

Garrido-Jurado, S., Muñoz-Salinas, R., Madrid-Cuevas, F. J., & Marín-Jiménez, M. J. (2014). Automatic generation and detection of highly reliable fiducial markers un- der occlusion. Pattern Recognition, 47(6), 2280–2292.