Travel photo and video summarization with cross-media correlation and mutual influence

Wei Ta Chu, Che Cheng Lin, Jen Yu Yu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents how cross-media correlation facilitates summarization of photos and videos captured in journeys. Correlation between photos and videos comes from similar content captured in the same temporal order. We transform photos and videos into sequences of visual word histograms, and adopt approximate sequence matching to find correlation. To summarize photos and videos, we propose that the characteristics of correlated photos can be utilized in selecting important video segments into video summaries, and on the other hand, the characteristics of correlated video segments can be utilized in selecting important photos. Experimental results demonstrate that the proposed summarization methods well take advantage of the correlation.

Original languageEnglish
Title of host publicationAdvances in Multimedia Modeling - 16th International Multimedia Modeling Conference, MMM 2010, Proceedings
Pages577-587
Number of pages11
DOIs
Publication statusPublished - 2009
Event16th International Multimedia Modeling Conference on Advances in Multimedia Modeling, MMM 2010 - Chongqing, China
Duration: 2010 Oct 62010 Oct 8

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5916 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference16th International Multimedia Modeling Conference on Advances in Multimedia Modeling, MMM 2010
CountryChina
CityChongqing
Period10-10-0610-10-08

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Travel photo and video summarization with cross-media correlation and mutual influence'. Together they form a unique fingerprint.

Cite this