擴增物體於VR360之研究

Study on Augmenting Objects in VR360

劉又萱(Iou-Shiuan Liu)

指導教授 ： 洪一平

國立臺灣大學/電機資訊學院/資訊工程學研究所/碩士(2019年)

https://doi.org/10.6342/NTU201903779

摘要

隨著虛擬實境技術的進步以及環景相機的發展，許多製片公司透過360度立體環景影像來做紀錄片、新聞，甚至VR電影。這類影片跟傳統影片一樣，時常需要後製物件在影片中，然而現有的環景影像編輯工具很難將後製的物體以合適的大小比例與對應的距離位置擺放至立體環景影像中，更別提要達到被前景物體遮蔽的效果。在這篇論文中，我們提出一套擴增物體於360度立體環景影像的流程，基於立體類廣告牌的顯示方式將前景物件與背景分離，允許擴增的立體物體能夠放置於前景物體的後方位置也確保該物體放置於原影像中對應的地面上。最後，本篇論文以四項實驗來驗證這套系統。前三個實驗結果顯示，立體類廣告牌與原始影像的立體感程度幾乎一致，而且當有物體在周圍移動的時候，會提高人眼對立體類廣告牌的立體感。第四個實驗結果顯示，透過我們的方法在立體環景圖裡面放置立體類廣告牌與立體模型很難被觀眾察覺。我們可以得出結論：針對立體環境圖，立體類廣告牌可以有效地遮蔽擴增的立體物件同時也不會降低其立體視覺效果。

關鍵字

立體環景圖 ； 擴增實境 ； 360虛擬實境 ； 沉浸式體驗

並列摘要

With the progress of virtual reality and spherical panoramic cameras, it is no longer difficult to capture stereo panoramas viz., stereoscopic spherical panoramas. Many companies utilize VR360 to make documentaries, news, and even VR movies. These films, like traditional movies, often need to augment post-production objects in the movie. However, the existing editing tools for panoramas are hard to augment 3D objects with suitable scale, position, and occlusion. In this study, we propose a stereoscopic panorama based (SP-based) quasi-billboard for displaying the foreground object, which allows augmented objects to be placed behind the foreground objects in VR360. We have conducted four experiments to verify our method. The first three experiments show that the stereoscopic score of the SP-based quasi-billboards are almost the same as the original image pairs and the score will increase when there is an object moving around it. The last experiment shows that the SP-based quasi-billboards and the augmented 3D objects are hard to be discovered by viewers. As a result, the quasi-billboards can be effective in occluding the augmented objects without reducing its stereoscopic visual effect.

並列關鍵字

Stereoscopic panorama ； Augmented reality ； VR360 ； Immersive experience

參考文獻

[1] Hiroshi Ishiguro, Masashi Yamamoto and Saburo Tsuji, "Omni-directional stereo for making global map", In Proceedings Third International Conference on Computer Vision, IEEE, pp.540-547, 1990.

[2] Robert Anderson, David Gallup, Jonathan T. Barron and Janne Kontkanen, "Jump: virtual reality video", ACM Transactions on Graphics (TOG), Vol.35, Issue.6, No.198, 2016.

[3] Facebook Surround 360, https://facebook360.fb.com/facebook-surround-360/, 2016.

[4] Kevin Matzen, Michael F. Cohen, Bryce Evans, Johannes Kopf and Richard Szeliski, "Low-cost 360 stereo photography and video capture", ACM Transactions on Graphics (TOG), Vol. 36, Issue.4, No.148, 2017.

[5] Hong-Shiang Lin, Chao-Chin Chang, Hsu-Yu Chang, Yung-Yu Chuang, Tzong-Li Lin and Ming Ouhyoung, "A Low-Cost Portable Polycamera for Stereoscopic 360 Imaging", IEEE Transactions on Circuits and Systems for Video Technology, Vol. 29, Issue. 4, pp.915-929, 2019.