動畫內容自動摘要技術之研究

A Study on Automatic Human Motion Summarization

王治凱(Chih-Kai Wang)

指導教授 ： 楊熙年

國立清華大學/電機資訊學院/資訊工程學系/碩士(2007年)

摘要

很多被使用在動畫、商業廣告或是遊戲當中的動作資料(motion capture data)都需要動用很多人力將這些取得不易的資料切成各個不同行為的區段(segment)。假設我們擁有非常龐大的動作資料庫，可以想見此處理過程所耗費的人力將會相當龐大，於是如何能根據動作內容將動作資料做適當地分段變成一個很重要的議題。
在本篇論文中，我們提出一種動作資料的自動分段方法，它不僅能使同樣動作落在同一區段，而且每個動作都能透過我們提出的方法產生摘要性之文字描述，以提供使用者具語意性較高階之互動環境。
首先，我們提出新的動作表示法，它包括兩種特徵值(features)，亦即整體特徵(global features)和相對肢體局部特徵(local features)兩種。整體特徵可用來觀察身體的動作，相對肢體局部特徵則是四肢的動作。由於我們定義的特徵可使得每個特徵的正負值都有其對應的文字，因此我們可以從觀察特徵值正負號的變化知道動作資料現在正在進行的動作。
最後，我們以多組實例來驗證本方法之有效性，並討論它未來之發展方向。

關鍵字

動作分析 ； 關鍵影格萃取 ； 動作摘要

並列摘要

The motion capture data used in animation, commercial advertisement, or video games require much manpower to segment the data into distinct behavior. If the size of database is large, the cost of segmentation process becomes inevitably high. Thus, automatic segmentation becomes an important issue in processing human motion data.

In this thesis, we proposed a method for segmenting the mocap data automatically. Our method not only can segment similar motion into a clip, but also gives each segment a text description, which provides a high level interactive environment for animators.

First we propose a new motion representation, in other words, we define two features for each motion, namely, the global feature and local feature. The global features refer to the movements of torso and the local features are movements of the limbs. Based on these features and their signs we can provide textual abstraction of the motion clip, in other words we can understand the motion data by observing the variations of features. Finally we give several empirical examples to show the effectiveness of the proposed method.

並列關鍵字

Motion analysis ； Keyframe extraction ； Motion summarization

參考文獻

CHAO, S.-P., CHIU, C.-Y., YANG, S.-N., AND LIN, T.-G. 2004. Tai chi synthesizer: A motion synthesis framework based on keypostures and motion instructions. Computer Animation and Virtual Worlds 15, 3-4, 259–268.

CLEVELAND, W. 1979. Robust locally weighted regression and smoothing scatterplots. Journal of the American Statistical Association 74, 368, 829–836.

FRIEDMAN, D., FELDMAN, Y. A., SHAMIR, A., AND DAGAN, T. 2004. Automated creation of movie summaries in interactive virtual environments. In Proceedings of the IEEE Virtual Reality 2004, 191–198.

GOLDMAN, D. B., CURLESS, B., SALESIN, D., AND SEITZ, S. M. 2006. Schematic storyboarding for video visualization and editing. ACM Transactions on Graphics 25, 3, 862–871.

HORI, C., AND FURUI, S. 2003. A new approach to automatic speech summarization. IEEE Transactions on Multimedia 5, 3, 368–378.