Travel photo and video summarization with cross-media correlation and mutual influence

Wei Ta Chu, Che Cheng Lin, Jen Yu Yu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents how cross-media correlation facilitates summarization of photos and videos captured in journeys. Correlation between photos and videos comes from similar content captured in the same temporal order. We transform photos and videos into sequences of visual word histograms, and adopt approximate sequence matching to find correlation. To summarize photos and videos, we propose that the characteristics of correlated photos can be utilized in selecting important video segments into video summaries, and on the other hand, the characteristics of correlated video segments can be utilized in selecting important photos. Experimental results demonstrate that the proposed summarization methods well take advantage of the correlation.

Original languageEnglish
Title of host publicationAdvances in Multimedia Modeling - 16th International Multimedia Modeling Conference, MMM 2010, Proceedings
Pages577-587
Number of pages11
DOIs
Publication statusPublished - 2009 Dec 1
Event16th International Multimedia Modeling Conference on Advances in Multimedia Modeling, MMM 2010 - Chongqing, China
Duration: 2010 Oct 62010 Oct 8

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5916 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference16th International Multimedia Modeling Conference on Advances in Multimedia Modeling, MMM 2010
CountryChina
CityChongqing
Period10-10-0610-10-08

Fingerprint

Video Summarization
Summarization
Histogram
Transform
Influence
Experimental Results
Demonstrate

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Chu, W. T., Lin, C. C., & Yu, J. Y. (2009). Travel photo and video summarization with cross-media correlation and mutual influence. In Advances in Multimedia Modeling - 16th International Multimedia Modeling Conference, MMM 2010, Proceedings (pp. 577-587). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5916 LNCS). https://doi.org/10.1007/978-3-642-11301-7_57
Chu, Wei Ta ; Lin, Che Cheng ; Yu, Jen Yu. / Travel photo and video summarization with cross-media correlation and mutual influence. Advances in Multimedia Modeling - 16th International Multimedia Modeling Conference, MMM 2010, Proceedings. 2009. pp. 577-587 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{d7ba26d9e0f24062be2fdf62d642098c,
title = "Travel photo and video summarization with cross-media correlation and mutual influence",
abstract = "This paper presents how cross-media correlation facilitates summarization of photos and videos captured in journeys. Correlation between photos and videos comes from similar content captured in the same temporal order. We transform photos and videos into sequences of visual word histograms, and adopt approximate sequence matching to find correlation. To summarize photos and videos, we propose that the characteristics of correlated photos can be utilized in selecting important video segments into video summaries, and on the other hand, the characteristics of correlated video segments can be utilized in selecting important photos. Experimental results demonstrate that the proposed summarization methods well take advantage of the correlation.",
author = "Chu, {Wei Ta} and Lin, {Che Cheng} and Yu, {Jen Yu}",
year = "2009",
month = "12",
day = "1",
doi = "10.1007/978-3-642-11301-7_57",
language = "English",
isbn = "3642113001",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "577--587",
booktitle = "Advances in Multimedia Modeling - 16th International Multimedia Modeling Conference, MMM 2010, Proceedings",

}

Chu, WT, Lin, CC & Yu, JY 2009, Travel photo and video summarization with cross-media correlation and mutual influence. in Advances in Multimedia Modeling - 16th International Multimedia Modeling Conference, MMM 2010, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 5916 LNCS, pp. 577-587, 16th International Multimedia Modeling Conference on Advances in Multimedia Modeling, MMM 2010, Chongqing, China, 10-10-06. https://doi.org/10.1007/978-3-642-11301-7_57

Travel photo and video summarization with cross-media correlation and mutual influence. / Chu, Wei Ta; Lin, Che Cheng; Yu, Jen Yu.

Advances in Multimedia Modeling - 16th International Multimedia Modeling Conference, MMM 2010, Proceedings. 2009. p. 577-587 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5916 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Travel photo and video summarization with cross-media correlation and mutual influence

AU - Chu, Wei Ta

AU - Lin, Che Cheng

AU - Yu, Jen Yu

PY - 2009/12/1

Y1 - 2009/12/1

N2 - This paper presents how cross-media correlation facilitates summarization of photos and videos captured in journeys. Correlation between photos and videos comes from similar content captured in the same temporal order. We transform photos and videos into sequences of visual word histograms, and adopt approximate sequence matching to find correlation. To summarize photos and videos, we propose that the characteristics of correlated photos can be utilized in selecting important video segments into video summaries, and on the other hand, the characteristics of correlated video segments can be utilized in selecting important photos. Experimental results demonstrate that the proposed summarization methods well take advantage of the correlation.

AB - This paper presents how cross-media correlation facilitates summarization of photos and videos captured in journeys. Correlation between photos and videos comes from similar content captured in the same temporal order. We transform photos and videos into sequences of visual word histograms, and adopt approximate sequence matching to find correlation. To summarize photos and videos, we propose that the characteristics of correlated photos can be utilized in selecting important video segments into video summaries, and on the other hand, the characteristics of correlated video segments can be utilized in selecting important photos. Experimental results demonstrate that the proposed summarization methods well take advantage of the correlation.

UR - http://www.scopus.com/inward/record.url?scp=77249090743&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77249090743&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-11301-7_57

DO - 10.1007/978-3-642-11301-7_57

M3 - Conference contribution

AN - SCOPUS:77249090743

SN - 3642113001

SN - 9783642113000

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 577

EP - 587

BT - Advances in Multimedia Modeling - 16th International Multimedia Modeling Conference, MMM 2010, Proceedings

ER -

Chu WT, Lin CC, Yu JY. Travel photo and video summarization with cross-media correlation and mutual influence. In Advances in Multimedia Modeling - 16th International Multimedia Modeling Conference, MMM 2010, Proceedings. 2009. p. 577-587. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-642-11301-7_57