Cross-media correlation: A case study of navigated hypermedia documents

Wei Ta Chu, Herng Yow Chen

Research output: Contribution to conferencePaper

7 Citations (Scopus)

Abstract

The research issues on multiple media correlation have arisen with more and more integrated multimedia applications. The multimedia correlation is used to coordinate different media and facilitate cross-media access. This paper presents our work on two types of multimedia correlation: explicit and implicit relations. We develop a system to carefully capture explicit relations and devise some computed synchronization processes to discover implicit relations between media objects. The proposed computed synchronization techniques, including speech-text alignment process in temporal domain, automatic scrolling process in spatial domain, and content dependency check process in content domain, will be addressed. Experimental results show that in the speech-text alignment process 80% of forced alignment are in-sync even the speech recognition accuracy is as low as 25%. The automatic scrolling process effectively maintains a resynchronization mechanism in different displaying environments.

Original languageEnglish
Pages57-66
Number of pages10
Publication statusPublished - 2002 Dec 1
Event10th International Conference of Multimedia - Juan les Pins, France
Duration: 2002 Dec 12002 Dec 6

Conference

Conference10th International Conference of Multimedia
CountryFrance
CityJuan les Pins
Period02-12-0102-12-06

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Computer Science(all)

Cite this

Chu, W. T., & Chen, H. Y. (2002). Cross-media correlation: A case study of navigated hypermedia documents. 57-66. Paper presented at 10th International Conference of Multimedia, Juan les Pins, France.