Cross-media correlation: A case study of navigated hypermedia documents

Wei Ta Chu, Herng Yow Chen

研究成果: Paper

7 引文 (Scopus)

摘要

The research issues on multiple media correlation have arisen with more and more integrated multimedia applications. The multimedia correlation is used to coordinate different media and facilitate cross-media access. This paper presents our work on two types of multimedia correlation: explicit and implicit relations. We develop a system to carefully capture explicit relations and devise some computed synchronization processes to discover implicit relations between media objects. The proposed computed synchronization techniques, including speech-text alignment process in temporal domain, automatic scrolling process in spatial domain, and content dependency check process in content domain, will be addressed. Experimental results show that in the speech-text alignment process 80% of forced alignment are in-sync even the speech recognition accuracy is as low as 25%. The automatic scrolling process effectively maintains a resynchronization mechanism in different displaying environments.

原文English
頁面57-66
頁數10
出版狀態Published - 2002 十二月 1
事件10th International Conference of Multimedia - Juan les Pins, France
持續時間: 2002 十二月 12002 十二月 6

Conference

Conference10th International Conference of Multimedia
國家France
城市Juan les Pins
期間02-12-0102-12-06

指紋

Synchronization
Speech recognition

All Science Journal Classification (ASJC) codes

  • Computer Science(all)

引用此文

Chu, W. T., & Chen, H. Y. (2002). Cross-media correlation: A case study of navigated hypermedia documents. 57-66. 論文發表於 10th International Conference of Multimedia, Juan les Pins, France.
Chu, Wei Ta ; Chen, Herng Yow. / Cross-media correlation : A case study of navigated hypermedia documents. 論文發表於 10th International Conference of Multimedia, Juan les Pins, France.10 p.
@conference{f303b49905964f67a7a526122e768878,
title = "Cross-media correlation: A case study of navigated hypermedia documents",
abstract = "The research issues on multiple media correlation have arisen with more and more integrated multimedia applications. The multimedia correlation is used to coordinate different media and facilitate cross-media access. This paper presents our work on two types of multimedia correlation: explicit and implicit relations. We develop a system to carefully capture explicit relations and devise some computed synchronization processes to discover implicit relations between media objects. The proposed computed synchronization techniques, including speech-text alignment process in temporal domain, automatic scrolling process in spatial domain, and content dependency check process in content domain, will be addressed. Experimental results show that in the speech-text alignment process 80{\%} of forced alignment are in-sync even the speech recognition accuracy is as low as 25{\%}. The automatic scrolling process effectively maintains a resynchronization mechanism in different displaying environments.",
author = "Chu, {Wei Ta} and Chen, {Herng Yow}",
year = "2002",
month = "12",
day = "1",
language = "English",
pages = "57--66",
note = "10th International Conference of Multimedia ; Conference date: 01-12-2002 Through 06-12-2002",

}

Chu, WT & Chen, HY 2002, 'Cross-media correlation: A case study of navigated hypermedia documents', 論文發表於 10th International Conference of Multimedia, Juan les Pins, France, 02-12-01 - 02-12-06 頁 57-66.

Cross-media correlation : A case study of navigated hypermedia documents. / Chu, Wei Ta; Chen, Herng Yow.

2002. 57-66 論文發表於 10th International Conference of Multimedia, Juan les Pins, France.

研究成果: Paper

TY - CONF

T1 - Cross-media correlation

T2 - A case study of navigated hypermedia documents

AU - Chu, Wei Ta

AU - Chen, Herng Yow

PY - 2002/12/1

Y1 - 2002/12/1

N2 - The research issues on multiple media correlation have arisen with more and more integrated multimedia applications. The multimedia correlation is used to coordinate different media and facilitate cross-media access. This paper presents our work on two types of multimedia correlation: explicit and implicit relations. We develop a system to carefully capture explicit relations and devise some computed synchronization processes to discover implicit relations between media objects. The proposed computed synchronization techniques, including speech-text alignment process in temporal domain, automatic scrolling process in spatial domain, and content dependency check process in content domain, will be addressed. Experimental results show that in the speech-text alignment process 80% of forced alignment are in-sync even the speech recognition accuracy is as low as 25%. The automatic scrolling process effectively maintains a resynchronization mechanism in different displaying environments.

AB - The research issues on multiple media correlation have arisen with more and more integrated multimedia applications. The multimedia correlation is used to coordinate different media and facilitate cross-media access. This paper presents our work on two types of multimedia correlation: explicit and implicit relations. We develop a system to carefully capture explicit relations and devise some computed synchronization processes to discover implicit relations between media objects. The proposed computed synchronization techniques, including speech-text alignment process in temporal domain, automatic scrolling process in spatial domain, and content dependency check process in content domain, will be addressed. Experimental results show that in the speech-text alignment process 80% of forced alignment are in-sync even the speech recognition accuracy is as low as 25%. The automatic scrolling process effectively maintains a resynchronization mechanism in different displaying environments.

UR - http://www.scopus.com/inward/record.url?scp=0037700963&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0037700963&partnerID=8YFLogxK

M3 - Paper

AN - SCOPUS:0037700963

SP - 57

EP - 66

ER -

Chu WT, Chen HY. Cross-media correlation: A case study of navigated hypermedia documents. 2002. 論文發表於 10th International Conference of Multimedia, Juan les Pins, France.