以手勢控制實時生成現場物體三維模型之互動應用裝置

Grab-Carry-Release: Virtually Placing Physical Objects in a Real Scene through a Smartphone with a RGB-D Camera

林玉芯(Yu-Hsin Lin)

指導教授 ： 陳炳宇

國立臺灣大學/管理學院/資訊管理學研究所/碩士(2012年)

https://doi.org/10.6342/NTU.2012.02600

摘要

無資料

關鍵字

設計 ； 人因 ； 互動 ； 手持擴增實境 ； 協同式擴增實境 ； 實時模型重建

並列摘要

This paper presents a novel interaction for Handheld Augmented Reality, Grab-Carry-Release, to allow users to communicate visually and experiment with the placement of physical objects in a real scene in situ through smartphones.
In the Grab-Carry-Release process, a user first grabs a physical object on the touchscreen of a smartphone to reconstruct a virtual copy of the object on the fly, then carries it by moving the smartphone, and finally releases it at the target location. To achieve this, a RGB-D camera is attached to the smartphone in order to capture the geometry and appearance of the object simultaneously with a contour tracking and model reconstruction pipeline. The RGB-D camera is also used for locating the reconstructed virtual model with its surrounding physical environment. In addition, possible usage scenarios for in-situ AR interaction and in-situ & remote mobile AR collaboration are developed. Finally, a user study is conducted to gather user feedbacks for future improvement of the proposed interactions.

並列關鍵字

Design ； Human Factors ； Interaction ； Handheld Augmented Reality ； Collaborative Augmented Reality ； Real-time Model Reconstruction

參考文獻

[3] R. Azuma. A survey of augmented reality. Presence: Teleoperators and Virtual Environments, 6(4):355–385, 1997.

Augmented Reality, pages 199–205, 2010.

[7] P. Besl and N. McKay. A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2):239–256.

[8] M. Billinghurst, D. Belcher, A. Gupta, and K. Kiyokawa. Communication behaviors in colocated collaborative ar interfaces. International Journal of Human-Computer Interaction, 16:395–423, 2003.

[9] M. Billinghurst, S.Weghorst, and T. Furness. Shared space: An augmented reality approach for computer supported collaborative work. Virtual Reality, 3(1):25–36, 1998.