Travel video scene detection by search

Wei Ta Chu, Cheng Jung Li, Tsung Che Lin

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

We propose an approach to conduct video scene detection especially for travel videos captured by amateur photographers in journeys. The correlation between a travel video and its corresponding text-based travel schedule is discovered. Because scene boundaries are clearly defined in schedules, we segment videos into scenes by checking the discovered cross-media correlation. To make these two modalities comparable, photos related to the visited scenic spots are retrieved from image search engines, by the keywords extracted from text-based schedules. Sequences of keyframes and retrieved photos are represented as visual word histograms, and the problem of correlation determination is then transformed as an approximate sequence matching problem. The experimental results verify the effectiveness of the proposed idea, and show the promising research direction of utilizing cross-media correlation in media analysis.

Original languageEnglish
Title of host publicationProceedings - 4th Pacific-Rim Symposium on Image and Video Technology, PSIVT 2010
Pages180-185
Number of pages6
DOIs
Publication statusPublished - 2010 Dec 1
Event4th Pacific-Rim Symposium on Image and Video Technology, PSIVT 2010 - Singapore, Singapore
Duration: 2010 Nov 142010 Nov 17

Publication series

NameProceedings - 4th Pacific-Rim Symposium on Image and Video Technology, PSIVT 2010

Other

Other4th Pacific-Rim Symposium on Image and Video Technology, PSIVT 2010
CountrySingapore
CitySingapore
Period10-11-1410-11-17

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Human-Computer Interaction
  • Software

Cite this

Chu, W. T., Li, C. J., & Lin, T. C. (2010). Travel video scene detection by search. In Proceedings - 4th Pacific-Rim Symposium on Image and Video Technology, PSIVT 2010 (pp. 180-185). [5673861] (Proceedings - 4th Pacific-Rim Symposium on Image and Video Technology, PSIVT 2010). https://doi.org/10.1109/PSIVT.2010.37