Optimized comics-based storytelling for temporal image sequences

Wei Ta Chu, Chia Hsiang Yu, Hsin Han Wang

Research output: Contribution to journalArticlepeer-review

8 Citations (Scopus)

Abstract

We propose a system to transform any temporal image sequence into a comics-based presentation, as an effective and interesting storytelling manner. Three main components, including page allocation, layout selection, and speech balloon placement, are respectively formulated as optimization problems, and systematic approaches are proposed to find solutions. Page allocation is viewed as a labeling problem, and the best solution is determined by the genetic algorithm. Importance values of images and predefined layouts are both represented in vector forms, and the best layout is selected by finding the best match between vectors. Feasible solutions of speech balloons constitute a solution space, and the best solution that jointly describes the best locations of all balloons in a page is determined by the particle swarm optimization algorithm. Objective evaluation and subjective evaluation are designed from various perspectives to demonstrate effectiveness and superiority of the proposed system.

Original languageEnglish
Article number6990620
Pages (from-to)201-215
Number of pages15
JournalIEEE Transactions on Multimedia
Volume17
Issue number2
DOIs
Publication statusPublished - 2015 Feb 1

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Media Technology
  • Computer Science Applications
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Optimized comics-based storytelling for temporal image sequences'. Together they form a unique fingerprint.

Cite this