TY - GEN
T1 - Travel video scene detection by search
AU - Chu, Wei Ta
AU - Li, Cheng Jung
AU - Lin, Tsung Che
PY - 2010/12/1
Y1 - 2010/12/1
N2 - We propose an approach to conduct video scene detection especially for travel videos captured by amateur photographers in journeys. The correlation between a travel video and its corresponding text-based travel schedule is discovered. Because scene boundaries are clearly defined in schedules, we segment videos into scenes by checking the discovered cross-media correlation. To make these two modalities comparable, photos related to the visited scenic spots are retrieved from image search engines, by the keywords extracted from text-based schedules. Sequences of keyframes and retrieved photos are represented as visual word histograms, and the problem of correlation determination is then transformed as an approximate sequence matching problem. The experimental results verify the effectiveness of the proposed idea, and show the promising research direction of utilizing cross-media correlation in media analysis.
AB - We propose an approach to conduct video scene detection especially for travel videos captured by amateur photographers in journeys. The correlation between a travel video and its corresponding text-based travel schedule is discovered. Because scene boundaries are clearly defined in schedules, we segment videos into scenes by checking the discovered cross-media correlation. To make these two modalities comparable, photos related to the visited scenic spots are retrieved from image search engines, by the keywords extracted from text-based schedules. Sequences of keyframes and retrieved photos are represented as visual word histograms, and the problem of correlation determination is then transformed as an approximate sequence matching problem. The experimental results verify the effectiveness of the proposed idea, and show the promising research direction of utilizing cross-media correlation in media analysis.
UR - http://www.scopus.com/inward/record.url?scp=78751656167&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=78751656167&partnerID=8YFLogxK
U2 - 10.1109/PSIVT.2010.37
DO - 10.1109/PSIVT.2010.37
M3 - Conference contribution
AN - SCOPUS:78751656167
SN - 9780769542850
T3 - Proceedings - 4th Pacific-Rim Symposium on Image and Video Technology, PSIVT 2010
SP - 180
EP - 185
BT - Proceedings - 4th Pacific-Rim Symposium on Image and Video Technology, PSIVT 2010
T2 - 4th Pacific-Rim Symposium on Image and Video Technology, PSIVT 2010
Y2 - 14 November 2010 through 17 November 2010
ER -