近年來圖片描述的產生已經有相當不錯的成果,然而,當今的方法仍有些缺陷,由於只能夠描述表面上的物件,如樣式或顏色等,缺乏了實用性,只能夠產生比較罐頭式的句子,這些句子缺乏了人與人之間的情感聯繫。因此我們提出了 Netizen Style Commenting (NSC),用來對時尚照片產生有特色的評論,我們致力於讓評論的風格具有如同網路上鄉民般生動活潑的風格,希望能增加與使用者情感上的連結。我們的作品主要有三個的部分,第一個是大規模的穿搭評論資料集,第二個是對於多樣性的衡量方式,最後是我們透過結合了Topic model與類神經網路來補足傳統方法的不足。
Recently, image captioning has achieved promising results. However, current works have several deficiencies. They have low utilities as simply generating “vanilla” sentences, which only describe shallow appearances (e.g., types, colors) in photos - lacking engagements and user intentions. Therefore, we propose Netizen Style Commenting (NSC), to generate characteristic comments to a user-contributed fashion photo. We are devoted to modulating the comments in a vivid “netizen” style which reflects the culture in a designated social community and hopes to facilitate more engagements with users. In this work, we design a novel framework that consists of three major components: (1) We construct a large-scale clothing dataset named NetiLook to discover netizen-style comments. (2) We propose three unique measures to estimate the diversity of comments. (3) We bring diversity by marrying topic model with neural networks to make up the insufficiency of conventional image captioning works.
為了持續優化網站功能與使用者體驗,本網站將Cookies分析技術用於網站營運、分析和個人化服務之目的。
若您繼續瀏覽本網站,即表示您同意本網站使用Cookies。