視訊透視頭戴式顯示器之影像內插

近年來虛擬實境技術蓬勃發展，已經能提供使用著相當真實的體驗，但結合虛擬實境與真實環境的技術，也就是擴增實境，則尚有許多進步空間；擴增實境目前有兩種實現方式，一種是光學透視式，另一種則是視訊透視式；視訊透視式雖然在虛擬部分能有相當真實的體驗，但透過攝影機所捕捉到真實世界則與肉眼所見有所出入，其中視角差異則會影響使用者對於距離感的認知。本研究針對視訊透視頭戴式顯示器中，修正影像給予使用者之距離感差異，我們利用基於深度影像之圖形渲染演算法來重新計算場景的相對距離，產生人眼視角之影像並呈獻給使用者，藉此修正距離感問題，並透過多台攝影機來解決不同視角的遮擋問題。為了驗證此方法之可行性，我們先在虛擬環境中模擬出接近真實之場景，在此環境中模擬裝設不同數量攝影機之視訊透視頭戴式顯示器，並比較各數量的攝影機所產生之結果；為了分析此方法給予使用者之效果，我們利用現行之頭戴式顯示器，加上深度攝影機取得外在環境之彩色與深度影像，實作此方法，並設計實驗與肉眼和現行之視訊透視方法做比較。

關鍵字

視訊透視；頭戴式顯示器；擴增實境；影像內插；基於深度影像之圖形渲染

並列摘要

Virtual reality technology has been booming nowadays, and can provide users truly experiences. However, augmented reality, the technology mixed the real world and the virtual world, still remains a long road to go. There are two methods to achieve augmented reality. One is optical see-through, and the other is video see-through. Video see-through method can provide a good experience on virtual part, but the real part captured by cameras still have some problem, especially the distance perception. In this thesis, we focus on video see-through head-mounted display, and try to remove the error due to the distance between cameras and users. We use depth image-based rendering algorithm to re-compute the true distance of the scene, and render the correct image to the user. And we use multiple cameras with different viewpoints to reduce the occlusion areas. To verify the feasibility of our method, we simulate a realistic scene and video see-through HMD with different numbers and positions of cameras in virtual environment, then we compare the results. In order to analyze the effect brought to the users, we implement the device with recent HMD and depth camera, and design an experiment to compare with human eyes and recent video see-through device.

並列關鍵字

Video see-through ； Head mounted display ； Augmented reality ； View interpolation ； Depth image-based rendering

參考文獻

[8] Steptoe, William, Simon Julier, and Anthony Steed. "Presence and discernability in conventional and non-photorealistic immersive augmented reality." Mixed and Augmented Reality (ISMAR), 2014 IEEE International Symposium on. IEEE, 2014.

[10] Zitnick, C. Lawrence, et al. "High-quality video view interpolation using a layered representation." ACM Transactions on Graphics (TOG). Vol. 23. No. 3. ACM, 2004.

[11] Fehn, Christoph. "Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV." Electronic Imaging 2004. International Society for Optics and Photonics, 2004.

[12] Smolic, Aljoscha, et al. "Intermediate view interpolation based on multiview video plus depth for advanced 3D video systems." 2008 15th IEEE International Conference on Image Processing. IEEE, 2008.

[13] Ndjiki-Nya, Patrick, et al. "Depth image-based rendering with advanced texture synthesis for 3-D video." IEEE Transactions on Multimedia 13.3 (2011): 453-465.

國際替代計量

視訊透視頭戴式顯示器之影像內插

全文下載

主題瀏覽