A user experience model for home video summarization

Wei Ting Peng, Wei Jia Huang, Wei Ta Chu, Chien Nan Chou, Wen Yan Chang, Chia Han Chang, Yi Ping Hung

Research output: Chapter in Book/Report/Conference proceedingConference contribution

15 Citations (Scopus)

Abstract

In this paper, we propose a novel system for automatically summarizing home videos based on a user experience model. The user experience model takes account of user's spontaneous behaviors when viewing videos. Based on users' reaction when viewing videos, we can construct a systematic framework to automate video summarization. In this work, we analyze the variations of viewer's eye movement and facial expression when he or she watching the raw home video. We transform these behaviors into the clues of determining the important part of each video shot. With the aids of music analysis, the developed system automatically generates a music video (MV) style summarized home videos. Experiments show that this new type of editing mechanism can effectively generate home video summaries and can largely reduce the efforts of manual summarization.

Original languageEnglish
Title of host publicationAdvances in Multimedia Modeling - 15th International Multimedia Modeling Conference, MMM 2009, Proceedings
Pages484-495
Number of pages12
DOIs
Publication statusPublished - 2009 Feb 4
Event15th International Multimedia Modeling Conference, MMM 2009 - Sophia-Antipolis, France
Duration: 2009 Jan 72009 Jan 9

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5371 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference15th International Multimedia Modeling Conference, MMM 2009
CountryFrance
CitySophia-Antipolis
Period09-01-0709-01-09

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'A user experience model for home video summarization'. Together they form a unique fingerprint.

  • Cite this

    Peng, W. T., Huang, W. J., Chu, W. T., Chou, C. N., Chang, W. Y., Chang, C. H., & Hung, Y. P. (2009). A user experience model for home video summarization. In Advances in Multimedia Modeling - 15th International Multimedia Modeling Conference, MMM 2009, Proceedings (pp. 484-495). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5371 LNCS). https://doi.org/10.1007/978-3-540-92892-8_48