Measuring and Predicting Visual Importance of Similar Objects

Yan Kong, Weiming Dong, Xing Mei, Chongyang Ma, Tong Yee Lee, Siwei Lyu, Feiyue Huang, Xiaopeng Zhang

研究成果: Article

4 引文 斯高帕斯(Scopus)

摘要

Similar objects are ubiquitous and abundant in both natural and artificial scenes. Determining the visual importance of several similar objects in a complex photograph is a challenge for image understanding algorithms. This study aims to define the importance of similar objects in an image and to develop a method that can select the most important instances for an input image from multiple similar objects. This task is challenging because multiple objects must be compared without adequate semantic information. This challenge is addressed by building an image database and designing an interactive system to measure object importance from human observers. This ground truth is used to define a range of features related to the visual importance of similar objects. Then, these features are used in learning-to-rank and random forest to rank similar objects in an image. Importance predictions were validated on 5,922 objects. The most important objects can be identified automatically. The factors related to composition (e.g., size, location, and overlap) are particularly informative, although clarity and color contrast are also important. We demonstrate the usefulness of similar object importance on various applications, including image retargeting, image compression, image re-attentionizing, image admixture, and manipulation of blindness images.

原文English
文章編號7374748
頁(從 - 到)2564-2578
頁數15
期刊IEEE Transactions on Visualization and Computer Graphics
22
發行號12
DOIs
出版狀態Published - 2016 十二月 1

    指紋

All Science Journal Classification (ASJC) codes

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design

引用此