使用關聯回饋從事以內容為基礎的環物影片檢索

Content-Based Object Movie Retrieval by Use of Relevance Feedback

詹力韋(Li-Wei Chan)

指導教授 ： 洪一平

國立臺灣大學/電機資訊學院/資訊工程學研究所/碩士(2004年)

https://doi.org/10.6342/NTU.2004.01749

摘要

本篇論文的目的在於建構一個環物影片內容檢索系統，藉由此系統，使用者可以方便地從龐大的環物影片資料庫中，基於環物影片內容檢索出所需要的環物影片。環物影片相較於三維物件具有更接近真實的展示能力，同時具有容易取得及提供足夠互動的優點。為取得環物影片，可以利用相機對真實的物件從各個不同的視點取像，所擷取出的一組影像則稱為此物件的環物影片；其中所產生影像的數量可視為相機對物件取樣的密度，理論上，兩個相似的物件各自產生的環物影片，其位置上相對應的影像應該也會相當相似。因此，累加所有相對應影像的差異距離可以代表兩個環物影片間的相似度。基於以上的想法，在此論文中，我們設計了兩種特徵描述來表示一個環物影片的組成，根據這些特徵描述，我們定義了兩個環物影片之間的相似度測量值。在我們的系統中，可以用兩種形式的輸入來執行檢索，一種是用目標物件的環物影片，另ㄧ種是只以目標物件少數幾個視點所取得的影像。最後，我們提出了一套使用於環物影片檢索的關聯回饋技術。透過關聯回饋，讓我們可以更清楚的知道使用者所欲查詢的概念。

關鍵字

內容檢索 ； 環物影片 ； 相似度測量值 ； 關聯回饋

並列摘要

The aim of this thesis is to build a content-based object movie retrieval system. It is to retrieve the desired object movies for a user from a large object movie database, based on the contents of object movies. Object movie is a good representation of a physical object because it can provide 3D interactive viewing effect, while not requiring 3D reconstruction. An object movie refers to a set of images captured from different perspectives around a physical object. An object movie can be mapped into a manifold in the feature space. Two different sets of feature descriptors, dense descriptor and condensed descriptor, are designed to sample the manifold. Based on these descriptors, we define the dissimilarity measure between the query and the target in the object movie database. The query we considered can be either a complete object movie or simply be subset of different views of the object. An algorithm for relevance feedback is also proposed in our system to capture the concepts a user has.

並列關鍵字

Relevance feedback ； Similarity measure ； Object movie ； Content-based retrieval

參考文獻

[6] M. C. Cyr and B. K. Benjamin, “3D Object Recognition Using Shape Similiarity-Based Aspect Graph”, in Proc. of ICCV 2001.

[7] Ming-Kuei Hu, ”Visual pattern recognition by moment invariants” Information Theory, IEEE Transactions on, Volume: 8, Issue: 2, pp. 179 – 187, Feb 1962.

[8] Yi-Ping Hung, Chu-Song Chen, Yu-Pao Tsai, and Szu-Wei Lin, “Augmenting Panoramas with Object Movies by Generating Novel Views with Disparity-Based View Morphing,” Journal of Visualization and Computer Animation, Special Issue on Hallucinating the Real World from Real Images, Vol. 13, pp. 237-247, 2002.

[9] Khotanzad, A., Hong, Y.H., “Invariant image recognition by Zernike moments” Pattern Analysis and Machine Intelligence, IEEE Transactions on , Volume: 12 , Issue: 5 , pp. 489 – 497, May 1990.

[10] Mahmoudi, S.; Daoudi, M.;”3D models retrieval by using characteristic views”, Pattern Recognition, 2002. Proceedings. 16th International Conference on , Volume: 2 , 11-15, vol.2, pp. 457 – 460, Aug 2002.