Blog Article Summarization with Image-Text Alignment Techniques

Wei Ta Chu, Ming Chih Kao

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

We propose an image-text alignment framework to match images with text, and take blog article summarization as the main application. Objects in an image are first detected, from them deep features are extracted and transformed into a space commonly shared with the text. On the other hand, sentences of a blog article are represented as vectors, and are also embedded into the common space. With these processes, cross-modal matching can be achieved. A blog article is then summarized in the representation of images and their matched sentences. In evaluation, we demonstrate the effectiveness of the proposed method, and show that the generated summary makes more sense.

Original languageEnglish
Title of host publicationProceedings - 2017 IEEE International Symposium on Multimedia, ISM 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages244-247
Number of pages4
ISBN (Electronic)9781538629369
DOIs
Publication statusPublished - 2017 Dec 28
Event19th IEEE International Symposium on Multimedia, ISM 2017 - Taichung, Taiwan
Duration: 2017 Dec 112017 Dec 13

Publication series

NameProceedings - 2017 IEEE International Symposium on Multimedia, ISM 2017
Volume2017-January

Conference

Conference19th IEEE International Symposium on Multimedia, ISM 2017
CountryTaiwan
CityTaichung
Period17-12-1117-12-13

All Science Journal Classification (ASJC) codes

  • Media Technology
  • Sensory Systems

Fingerprint Dive into the research topics of 'Blog Article Summarization with Image-Text Alignment Techniques'. Together they form a unique fingerprint.

Cite this