- 學位論文
以CIDOC CRM為基礎的推論平台–整合異質性影像資料庫的詮釋性與概念性知識
An Inference Platform Based on CIDOC CRM for Integrating Administrative and Conceptual Knowledge Among Heterogeneous Image Archives
摘要
近年來，隨著資料儲存技術的進步，使用者也開始大量產生數位影像，致使有效率地去儲存、搜尋和擷取所需的影像，也成為一個非常重要的課題。一般來說影像擷取技術可分為兩種類型：傳統關鍵字比對方法與以影像內容為基礎的查詢方法，但這兩種方式都有準確率不高且缺乏語意的問題，使用者無法直覺地利用這兩種方式去搜尋影像。之前的研究指出非專業的使用者比較偏好以基於事件的概念描述去尋找圖片，例如以「女人戴帽子」的概念性描述去做影像的擷取。在許多數位博物館中，有關這些概念性描述都存在影像非結構性文字描述的欄位裡，本研究以自然語言處理技術－語意角色標註，自動化地將這些非結構性的文字描述，轉化成為具有結構性的語意角色標註，使得利用基於事件的概念描述去做影像擷取變為可能，結果顯示採用這種方式，會比純粹將該事件以關鍵字去做比對的準確率會來得高。 本研究提供一個以本體論為基礎的方法，去整合影像後設資料的詮釋性知識與影像非結構性文字描述的詮釋性知識與概念性知識。這個目的是為了能夠自動化的產生使用者有興趣的隱性知識，例如在各異質性影像資料庫中，找出具有相同概念的事件且作者風格也相同的所有畫作。事實上，使用者要自行找出這樣的答案，他必須非常繁瑣地在各個不同的影像資料庫做相關性的查詢才有可能找得到。 因此，本論文利用一個在文化遺產領域已成為國際標準的CIDOC CRM做為本體論，以及結合語意網常用的工具軟體，例如Protégé, SWRL 與Jess推論引擎來建構一個推論平台，本研究想要探討的是在真實生活的異質性影像資料庫的詮釋性知識與概念性知識，該如何整合到以CIDOC CRM為基礎的推論平台，並藉此自動地推論出使用者有興趣的隱性知識，系統實作的結果顯示，本研究所提出的推論平台架構是可實際應用在真實生活異質性影像資料庫的整合。
並列摘要
Recently, advances in storage techniques have conducted to an increase in a lot amount of digital images all around the world. These developments have heightened the need for effective image retrieval techniques. Roughly speaking, image retrieval techniques can be divided into two areas: the traditional keyword-based approach and content-based image retrieval. But they still fail on low precision and lack semantic that will cause semantic gap between image features and the user. Previous studies have demonstrated that non-professional users prefer using event-based conceptual descriptions, such as “a woman wearing a hat”, to describe and search images. In many art image archives, these conceptual descriptions are manually annotated in free-text fields. We propose a novel approach for extracting event-based semantic knowledge automatically from free-text image descriptions. The semantic role labeling techniques appear to be a promising technology for transforming the unrestricted natural language texts into structured records that is easy to index/retrieve using relational database technologies. The precision of such SRL-assisted event-based image retrieval is much higher than that of the conventional keyword-based approach. This thesis proposes an ontology-based approach for integrating metadata-based image annotations (administrative knowledge) with event-based knowledge (administrative and conceptual knowledge), including subject, verb, object, location and temporal information from free-text image descriptions. The goal is to automatically derive certain interesting knowledge, such as, all the paintings with a same painting style and a same conceptual event in the image content that implicitly dispersed around different image archives. In practice, an answer to these questions requires a series of field-based queries, across different digital archives. This thesis investigated the possibility to utilize standardized ontology, CIDOC-CRM, and semantic web tools, such as Protégé, SWRL and Jess inference engine in order to model an inference platform. We discuss the need for a robust inference platform for real-life knowledge discovery and integration among heterogeneous image archives. Experimental results indicate the approach can be implemented in real-life applications.