A user experience model for home video summarization

Wei Ting Peng, Wei Jia Huang, Wei Ta Chu, Chien Nan Chou, Wen Yan Chang, Chia Han Chang, Yi Ping Hung

Research output: Chapter in Book/Report/Conference proceedingConference contribution

16 Citations (Scopus)


In this paper, we propose a novel system for automatically summarizing home videos based on a user experience model. The user experience model takes account of user's spontaneous behaviors when viewing videos. Based on users' reaction when viewing videos, we can construct a systematic framework to automate video summarization. In this work, we analyze the variations of viewer's eye movement and facial expression when he or she watching the raw home video. We transform these behaviors into the clues of determining the important part of each video shot. With the aids of music analysis, the developed system automatically generates a music video (MV) style summarized home videos. Experiments show that this new type of editing mechanism can effectively generate home video summaries and can largely reduce the efforts of manual summarization.

Original languageEnglish
Title of host publicationAdvances in Multimedia Modeling - 15th International Multimedia Modeling Conference, MMM 2009, Proceedings
Number of pages12
Publication statusPublished - 2009
Event15th International Multimedia Modeling Conference, MMM 2009 - Sophia-Antipolis, France
Duration: 2009 Jan 72009 Jan 9

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5371 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference15th International Multimedia Modeling Conference, MMM 2009

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)


Dive into the research topics of 'A user experience model for home video summarization'. Together they form a unique fingerprint.

Cite this