在過去的研究中,數位影像結合實體強調雙手可觸握操作的互動設計比較少, 而美國MIT Media Laboratory的David Merrill等人所開發的 Sifteo Cubes是所有「可觸握使用者介面(Tangible User Interface, TUI)」中最知名的一種,具有多種特別的物理性觸握的感知與資訊溝通功能。我們希望運用Sifteo Cubes方塊來開發兩件創新的使用者體驗互動裝置設計,以實現可觸握使用者介面在數位藝術的應用。 第一件應用設計作品〈字母魔獸〉將Sifteo Cubes結合擴增實境與互動桌的技術,利用擴增實境的標記圖卡來偵測每一個Sifteo Cubes方塊所在的位置,並與互動桌結合開發出互動英文拼字悅趣化學習遊戲。在遊戲上,使用者可以透過雙手拿起英文字母方塊來進行英文拼字遊戲,並利用Sifteo Cubes排序拼字與桌面上的影像做互動;而為了讓互動裝置更能貼近使用者,使用了卡通可愛的風格與動物寓言故事來製作動畫,讓使用者可以更能融入動畫情境之中,印證認知心理學家所提出的兒童在真實物理的環境中邊玩邊探索的學習效果會比較好。希望可以藉由〈字母魔獸〉研究,結合可觸握的互動介面、擴增實境應用以及卡通悅趣視覺化的設計方式建置一個創新的英語互動學習模式,達到寓教於樂的目的。 第二件應用設計作品〈方塊“鈕”〉是將Sifteo Cubes當作新式按鈕,應用於「可觸握式影片播放」,突破了一般制式按鈕無法隨意變換位置以及單一功能的缺點,利用Sifteo Cubes的搖晃、按壓以及排序Cubes賦予每個Cubes不同指令與控制影片的播放、暫停...等指令。作者以林智信畫家的「迎媽祖數位互動版畫」當示範展示內容,透過〈方塊“鈕”〉以活潑方式操控數位迎媽祖的投攝影片播放;除了一般的播放指令之外,當六個Cubes方塊排成一排時,迎媽祖的畫面片段便會分別下載至六個Cubes的螢幕中,按壓任一Cube,便可讓六個Cubes的動畫同步串接播放。 本論文將會對相關作品進行探討以及說明兩件作品的執行方法,最後針對作品進行檢討和改進。
In previous researches, digital images are rarely integrating with interactive design through objects by touch-grip. David Merrill et al. from MIT Media Laboratory developed “Sifteo cube” which is one of the most famous “tangible user interface” (TUI). Sifteo cubes contain many special physical touch grip sense perception and information communication functions. We will use Sifteo cubes to develop two innovative interaction design in order to achieve tangible user interface applications. About the first design “Spelling Monster”, we developed a system integrating augmented reality (AR) and interactive table technology and applied Sifteo cubes as the marker of AR to detect the cubes' location, and we used the system to design a joyful interactive English spelling game . In the game, users can pick up the cubes by hands for the English alphabetical spelling and have fun interaction with the images from the table. We used a cute cartoon style animal fables to design animations. The game is a new interactive English vocabulary learning which achieves the entertaining purpose. About the second design “Sifteo Button”, we transformed Sifteo cubes as a new touch-grip button for playing video. It solved the shortcomings of the general standard button which can not be changed their functions and positions. By the special functions of sifting, sorting, tilting, shaking, pressing and adjacency of Sifteo cubes. We created the different sort command and control movie playback, such as play, stop, pause ... and so on. We use “Digital Celebrating the Matsu Festival” of the famous artist Chin-Hsin Lin to be the demonstration content. Besides the cubes have the special button functions designed, when six cubes are put in a row, the system will download the video into cubes and play simultaneously. Besides, this thesis will discuss the relevant work and discuss how to implement two design by Sifteo cubes and finally will have the conclusion discussion.