- 學位論文
Kinect 動作捕捉技術在文字與語言認知之實現
The Implementation of Kinect Motion Capture Technology in Text and Language Cognition
摘要
動作捕捉技術的發展在各種領域已廣泛被使用，而且結合越來越多元的媒材一起做呈現，進而改變了參與者對互動藝術作品的認知與體驗。互動藝術的發展特色從接觸式物理性介面轉向感應式自然互動介面為走向，強調以自然互動介面作引發，使參與者的身體感知能主動地與作品互動。本論文乃探討「Kinect 動作捕捉技術在文字與語言認知之實現」，本人提出兩件與語言文字有關之作品〈交“心”〉與〈轉譯•遲疑〉來實現動作捕捉技術在語言文字上的創作，並強調自然互動介面的重要性。 第一件作品〈交“心”〉是透過中國傳統象形文字與人體肢體動作結合的一種體感互動作品，主要互動模式建構在人的空間與動作的知覺特性上，觀者把文字當作仿生物看待，進而會產生好奇心以體感與之互動，之後文字開始演變，而在這演變的過程中，參與者會了解到文字演變的成因，並產生共鳴，這是本作品想要傳達的理念。 第二件作品〈轉譯•遲疑〉在於分析人在言語轉譯過程中所產生的遲疑表情，是ㄧ個觀察他人並檢視自己的作品，目的希望觀者能從互動過程中去理解與認知他人與自身表情因語言轉譯所產生遲疑的真實美感。作品引導觀者唸台語，由國語轉台語的轉譯中，觀者的臉部可能會在非自主的狀態下反射出現遲疑表情，而作品系統將遲疑文字以漂浮呈現方式分離出來，此象徵人的思想游移不定。作品是由Kinect互動裝置來偵測與記錄參與者唸台語的反應與遲疑文字，最後以行為錄像藝術方式做展示呈現。 本論文目的希望以上兩件作品能帶給觀者新的自然互動感知，並在已有的技術做創新應用，同時強調讓人們以肢體做最自然的互動參與。
並列摘要
Motion capture technology have been fundamentally and popularly used in interactive artworks. For motion capture technology, evolving from works integrating physical touch sensors to contactless sensor interactions, interactive art now emphasizes using naturally interactive interfaces, which allow the participants to naturally use their bodys' motion to engage with the artwork. This thesis discusses“Kinect motion capture technology for text and language cognition” based on two pieces of artwork: “Make 'Heart'” and “Hesitation in Translation”. The purposes of the artworks focus on the advantages of human natural interactive motion. The first artwork, “Make 'Heart'”, is an interactive artwork through Chinese traditional hieroglyphs and human body action. It is based on our perception of space and body motion sensory and the words are wiewed as biomimetics. When the participants squat down and interact with the words projected on the floor, the words start to change shape. Through this deform, the causes and effects of the process begin to resonate with the participants. The second artwork, “Hesitation in Translation”, explores the hesitation when people get through the reasoning of the translation into different languages in Chinese poets. The artwork asks the participants to translate Chinese poets from Mandarin into Taiwanese, and speak out. The goal of the artwork is to let participants to realize and comprehend the beauty of the reality in hesitation when they learn the result from other people interacting with the artwork. The artwork dissociates the expressions from the translation and presents them separately to represent the instability of the thought processes associated with translation. The artwork is detected and recorded by Kinec. It records the reactions of participants who speak Taiwanese for the Chinese poets. This work is presented by performance video art. This thesis aims to use these two artworks to bring a new level of interactive experience to its participants. By using existing technology in creative ways, it make people use the most natural action to interact with the artworks.