Optimized speech balloon placement for automatic comics generation

Wei Ta Chu, Chia Hsiang Yu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

Comic presentation for videos has attracted more and more attention in recent years. This work deeply discusses one important component, i.e., speech balloon placement, that was depreciated and was done by heuristic approaches before. According to number of words and emotion embedded in subtitles, and audio energy corresponding to the targeted frame, speech balloons of various sizes and appropriate shapes are generated. How to locate speech balloons in panels at the same comic page is then formulated as an optimization problem. The objective function integrates an intra-panel cost with an inter-panel cost, where the former is designed to avoid occluding important regions of frames and to direct viewer's gaze, and the latter is designed to build the reading tempo. The experimental results show that the proposed method facilitates higher readability, higher content coverage, and better speech balloon placement.

Original languageEnglish
Title of host publicationIMMPD 2013 - Proceedings of the 3rd ACM International Workshop on Interactive Multimedia on Mobile and Portable Devices, Co-located with ACM Multimedia 2013
Pages1-6
Number of pages6
DOIs
Publication statusPublished - 2013 Nov 12
Event3rd ACM International Workshop on Interactive Multimedia on Mobile and Portable Devices, IMMPD 2013 - Co-located with ACM Multimedia 2013 - Barcelona, Spain
Duration: 2013 Oct 222013 Oct 22

Publication series

NameIMMPD 2013 - Proceedings of the 3rd ACM International Workshop on Interactive Multimedia on Mobile and Portable Devices, Co-located with ACM Multimedia 2013

Conference

Conference3rd ACM International Workshop on Interactive Multimedia on Mobile and Portable Devices, IMMPD 2013 - Co-located with ACM Multimedia 2013
CountrySpain
CityBarcelona
Period13-10-2213-10-22

All Science Journal Classification (ASJC) codes

  • Hardware and Architecture
  • Human-Computer Interaction

Fingerprint Dive into the research topics of 'Optimized speech balloon placement for automatic comics generation'. Together they form a unique fingerprint.

Cite this