擴增實境之多使用者合作與空間同步系統設計

” 延展實境” 允許多位用戶跨越空間地域限制，透過不同的獨立裝置跨平台進入同一世界互動協作。對於多用戶互動協作目前的研究尚存在幾項問題，包含遠程協作用戶交互和本地協作中擴增實境裝置的空間同步精確度與穩定度不足的問題，對於需要高精確度的多用戶場景，用戶間會看到明顯的虛擬物位置姿態差異。本研究提出了一套新穎的多使用者平台系統，在本地協作中允許多個AR設備整合其內部虛擬空間，完成實時信息空間同步，亦整合了遠程協作用戶的互動統合。我們使用了混和實境裝置 Microsoft HoloLens(1st gen) 進行設計與開發，並為其設計了簡易基礎的使用者介面以提升用戶感受及完成場景應用的前置效正作業。最終本論文設計了一套實驗流程來驗證此系統各項功能的完整性，並對於本地協作中多使用者的 AR 裝置評比了穩定度及精確性。實驗設置一，驗證了當系統運行時，對於 HoloLens 裝置的負載影響，其確保了 HoloLens 畫面更新率均能維持 40fps 以上; 實驗設置二驗證了多用戶 AR 裝置裝置精確度能夠達到6.8 ± 3.2 (mm) 距離誤差以及 0.4 ± 0.4 (degrees) 旋轉誤差，確保了各個使用者所見之虛擬物僅有毫米等級的差距; 實驗設置三則是驗證了個別裝置顯示虛擬物晃動的穩定度，其晃動幅度能有效抑制至 0.55mm 內。結果顯示了在延展實境的應用中，本研究提出的系統對於 HoloLens(1st gen) 使用是非常有可行性的，並可經過簡單適當的改動將系統移植到其他平台裝置中。

關鍵字

延展實境；擴增實境；多使用者協作；空間同步； HoloLens

並列摘要

”Extended Reality” allows multiple users to enter the same world for interaction and collaboration through different independent devices and cross-platforms without spatial geographical restrictions. There are still several problems in the current research on multi-user interaction and collaboration. Including the interaction of remote collaborators and the spatial synchronization accuracy and stability issues of AR devices in local collaboration. For multi-user scenarios that require high accuracy, users will see obvious position differences of virtual objects. In this study, we propose a novel multi-user platform system that allows multiple AR devices to integrate their internal virtual spaces in a local collaboration space to complete real-time information space synchronization. Then it also integrates the interactive integration of remote collaborative users. We use the mixed reality device Microsoft HoloLens (1st gen) for design and development, designing a simple and basic user interface to enhance the user experience and complete the pre-calibration of the scene application. Finally, this paper designs a set of experimental procedures to verify the integrity of each function of the system and evaluates the stability and accuracy of multi-user AR devices in local collaboration. Experiment1 verifies the loading impacts on the HoloLens when the system is running, which ensures that the HoloLens screen update rate can be maintained above 40fps; Experiment2 verifies that the accuracy of the multi-user AR device can reach 6.8 ± 3.2 (mm)of distance error and 0.4±0.4 (degrees) of rotation error. That ensures the virtual objects seen by each user are only millimeters apart; Experiment3 verifies the stability of virtual object shaking shown by equipment and its shaking amplitude can be effectively suppressed to within 0.55mm. The conclusion indicates that the system is very feasible for HoloLens (1st gen) in the application of extended reality. Also the system can be ported to other platform devices by simply and appropriately modified.

並列關鍵字

Extended Reality ； Augmented Reality ； Multi-User Collaboration ； Spatial Synchronization ； HoloLens

參考文獻

Grand view research. (2022) Augmented Reality Market Size, Share Trends Analysis Report By Component (Hardware, Software), By Display (Head-Mounted Display Smart Glass, Head-Up Display, Handheld Devices), By Application, By Region, And Segment Forecasts, 2022 - 2030. [Online]. Available: https://www.grandviewresearch.com/industry-analysis/augmented-reality-market.

Google Scholar

Microsoft. (2021)HoloLens1 Hardware [Online]. Available: https://docs.microsoft.com/en-us/hololens/hololens1-hardware

Google Scholar

Microsoft. (2022)Azure Spatial Anchors Overview [Online]. Available: https://docs.microsoft.com/en-us/azure/spatial-anchors/.

Google Scholar

F. Ababsa and M. Mallem. ”Robust Camera Pose Estimation Combining 2D/3DPoints and Lines Tracking”. In 2008 IEEE International Symposium on Industrial Electronics, pages 774–779. IEEE, 2008

Google Scholar

D. R. Allen, T. M. Peters, and E. Chen. ”A co-calibration framework for the accuracy assessment of vision-based tracking systems”. In Medical Imaging 2022:Image-Guided Procedures, Robotic Interventions, and Modeling, volume 12034,pages 598–608. SPIE, 2022.

Google Scholar

主題瀏覽