TY - GEN
T1 - Cross-media correlation
T2 - 10th ACM International Conference on Multimedia, MULTIMEDIA 2002
AU - Chu, Wei Ta
AU - Chen, Herng Yow
N1 - Funding Information:
for comments on the draft manuscript; Brian Molloy, John Sawyer, and geoff Davidson for discussion; Murray Dawson and anouk Wanrooy for assistance in preparing the figures; David Purcell for cultivating plants; Patricia eckel for providing the Latin diagnosis; and Colin Miskelly for drawing our attention to the issue of the orthography of O. traversii. PBH was supported by the New Zealand Foundation for Research Science and Technology through the Defining New Zealand's Land Biota OBi and gJH through the foundation's Sustaining and Restoring Biodiversity OBi.
Publisher Copyright:
© 2002 ACM.
PY - 2002/12/1
Y1 - 2002/12/1
N2 - The research issues on multiple media correlation have arisen with more and more integrated multimedia applications. The multimedia correlation is used to coordinate different media and facilitate cross-media access. This paper presents our work on two types of multimedia correlation: explicit and implicit relations. We develop a system to carefully capture explicit relations and devise some computed synchronization processes to discover implicit relations between media objects. The proposed computed synchronization techniques, including speech-text alignment process in temporal domain, automatic scrolling process in spatial domain, and content dependency check process in content domain, will be addressed. Experimental results show that in the speech-text alignment process 80% of forced alignment are in-sync even the speech recognition accuracy is as low as 25%. The automatic scrolling process effectively maintains a resynchronization mechanism in different displaying environments.
AB - The research issues on multiple media correlation have arisen with more and more integrated multimedia applications. The multimedia correlation is used to coordinate different media and facilitate cross-media access. This paper presents our work on two types of multimedia correlation: explicit and implicit relations. We develop a system to carefully capture explicit relations and devise some computed synchronization processes to discover implicit relations between media objects. The proposed computed synchronization techniques, including speech-text alignment process in temporal domain, automatic scrolling process in spatial domain, and content dependency check process in content domain, will be addressed. Experimental results show that in the speech-text alignment process 80% of forced alignment are in-sync even the speech recognition accuracy is as low as 25%. The automatic scrolling process effectively maintains a resynchronization mechanism in different displaying environments.
UR - http://www.scopus.com/inward/record.url?scp=85134311204&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85134311204&partnerID=8YFLogxK
U2 - 10.1145/641007.641017
DO - 10.1145/641007.641017
M3 - Conference contribution
AN - SCOPUS:85134311204
T3 - Proceedings of the 10th ACM International Conference on Multimedia, MULTIMEDIA 2002
SP - 57
EP - 66
BT - Proceedings of the 10th ACM International Conference on Multimedia, MULTIMEDIA 2002
PB - Association for Computing Machinery, Inc
Y2 - 1 December 2002 through 6 December 2002
ER -