Cross-media correlation: A case study of navigated hypermedia documents

Wei Ta Chu, Herng Yow Chen

Research output: Contribution to conferencePaperpeer-review

8 Citations (Scopus)


The research issues on multiple media correlation have arisen with more and more integrated multimedia applications. The multimedia correlation is used to coordinate different media and facilitate cross-media access. This paper presents our work on two types of multimedia correlation: explicit and implicit relations. We develop a system to carefully capture explicit relations and devise some computed synchronization processes to discover implicit relations between media objects. The proposed computed synchronization techniques, including speech-text alignment process in temporal domain, automatic scrolling process in spatial domain, and content dependency check process in content domain, will be addressed. Experimental results show that in the speech-text alignment process 80% of forced alignment are in-sync even the speech recognition accuracy is as low as 25%. The automatic scrolling process effectively maintains a resynchronization mechanism in different displaying environments.

Original languageEnglish
Number of pages10
Publication statusPublished - 2002 Dec 1
Event10th International Conference of Multimedia - Juan les Pins, France
Duration: 2002 Dec 12002 Dec 6


Conference10th International Conference of Multimedia
CityJuan les Pins

All Science Journal Classification (ASJC) codes

  • Computer Science(all)


Dive into the research topics of 'Cross-media correlation: A case study of navigated hypermedia documents'. Together they form a unique fingerprint.

Cite this