Multiple visual concept discovery using concept-based visual word clustering

Jun Bin Yeh, Chung Hsien Wu, Shi Xin Mai

研究成果: Article同行評審

2 引文 斯高帕斯(Scopus)

摘要

In recent research, visual concept discovery was used to fill the semantic gap for representing the visual content. However, multiple concepts in an image generally degrade the discovery accuracy. In this paper, a Concept-based Visual Word Clustering (CVWC) method is proposed to discover multiple concepts from an image without pre-segmented training images. The CVWC is based on prior knowledge of concepts, which are trained from meta-text of web images. First, concepts are obtained by clustering the visual words in the regions extracted from image segmentation. A concept-based genetic algorithm (CBGA) is applied for searching the near-optimal clusters according to the visual words (VWs) in a concept and the co-occurrence probability of two concepts. The clustering procedure is also performed on the neighboring VWs to discover all the regions for concept representation. A concept extension method (CE) is further applied for iteratively updating the discovered concepts from the clustered results. In the experiments on the application to video retrieval, the mAP of the proposed CVWC method based on CBGA and CE obtained satisfactory improvements of 0.04 and 0.06, compared to pixel-based image segmentation approach and conventional concept model approach for the category "nation defense," and 0.06 and 0.05 for the category "ecology," respectively.

原文English
頁(從 - 到)381-393
頁數13
期刊Multimedia Systems
19
發行號4
DOIs
出版狀態Published - 2013 7月

All Science Journal Classification (ASJC) codes

  • 軟體
  • 資訊系統
  • 媒體技術
  • 硬體和架構
  • 電腦網路與通信

指紋

深入研究「Multiple visual concept discovery using concept-based visual word clustering」主題。共同形成了獨特的指紋。

引用此