3D 可互動式桌面系統-以Kinect 為例

3D Interactive Deskop System - implement in kinect

黃灝程(Hou-Cheng Vong)

指導教授 ： 侯永昌

淡江大學/商管學院/資訊管理學系碩士班/碩士(2014年)

https://doi.org/10.6846/TKU.2014.00677

摘要

2D 的使用者介面已經使用了超過30年，一直以來都沒有什麼大的變化，即使時至今日個人電腦的硬體運算能力越來越強，特別是圖像處理元件(GPU) 讓3D繪圖處理越來越有效率，人們使用平板電腦或者智慧型手機完成他們生活上大部份的應用，但是圖形使用者介面依然保留二維的特性，這某程度上是一種浪費。

如果想要建立一個3D可互動式的環境，必要再經過一大堆複雜的處理，以及各方面的技術。3D 可互動式環境的靈感來自於真實世界人們跟桌面上的物件互動的方法，我們希望可以讓人機互動也可以一樣的簡單。由於要從無到有建立一個3D 可互動式環境是非常複雜且需要很多的時間，因此我們提供應用程式介面(Application Programming Interface) 來簡化建立3D 可互動式環境的開發流程。
本文將會提出一個3D 可互動環境的概念並提供API(Application Programming Interface)以簡化開發3D 可互動環境的流程，最後會使用我們所提供的API 實作一個小DEMO 程式，證明我們的API 是可以使用的。

關鍵字

人機介面 ； 物理引擎 ； Kinect

並列摘要

The 2D Graphic User Interface (GUI) have been used for 30 years. There are not any huge change. Even through the computing power of the hardware of personal computers (PCs) has become more and more powerful, especially the Graphic Process Unit (GPU), making the 3D Graphic Rendering more and more efficient and people using their tablet and smart phone to solve most of their problem, the GUI still keep its 2D feature. It is some kind of waste.

If developers want to build a 3D interactive environment from the ground to top, there must be a tons of work to do and problem to solve. The idea of 3D interactive environment was come from how people interact with the real world object. We hope we can make the human computer interaction as simple as the real world.

Since it is complicated and take a lot of time to build a 3D interactive environment, we provide an Application Programming Interface (API) to simplify the development.

In this paper, we propose the concept of 3D interactive environment and provide API to simplify the development and at last we implement a little demo program by using our API to prove our APIs are work

並列關鍵字

Human Computer Interface ； Physics Engine ； Kinect ； Wii Remote

參考文獻

Catuhe, D. (2012). Programming with the kinect for windows software development kit O'Reilly Media, Inc.

Francese, R., Passero, I., & Tortora, G. (2012). Wiimote and kinect: Gestural user interfaces add a natural third dimension to HCI. Paper presented at the Proceedings of the International Working Conference on Advanced Visual Interfaces, 116-123.

Oh, J., Jung, Y., Cho, Y., Hahm, C., Sin, H., & Lee, J. (2012). Hands-up: Motion recognition using kinect and a ceiling to improve the convenience of human life. Paper presented at the CHI'12 Extended Abstracts on Human Factors in Computing Systems, 1655-1660.

van Dantzich, M., Gorokhovsky, V., & Robertson, G. (1999). Application redirection: Hosting windows applications in 3D. Paper presented at the Proceedings of the 1999 Workshop on New Paradigms in Information Visualization and Manipulation in Conjunction with the Eighth ACM Internation Conference on Information and Knowledge Management, Kansas City, Missouri, USA. 87-91. doi:10.1145/331770.331791

6. 參考文獻