Abstract
The research issues on multiple media correlation have arisen with more and more integrated multimedia applications. The multimedia correlation is used to coordinate different media and facilitate cross-media access. This paper presents our work on two types of multimedia correlation: explicit and implicit relations. We develop a system to carefully capture explicit relations and devise some computed synchronization processes to discover implicit relations between media objects. The proposed computed synchronization techniques, including speech-text alignment process in temporal domain, automatic scrolling process in spatial domain, and content dependency check process in content domain, will be addressed. Experimental results show that in the speech-text alignment process 80% of forced alignment are in-sync even the speech recognition accuracy is as low as 25%. The automatic scrolling process effectively maintains a resynchronization mechanism in different displaying environments.
Original language | English |
---|---|
Pages | 57-66 |
Number of pages | 10 |
Publication status | Published - 2002 Dec 1 |
Event | 10th International Conference of Multimedia - Juan les Pins, France Duration: 2002 Dec 1 → 2002 Dec 6 |
Conference
Conference | 10th International Conference of Multimedia |
---|---|
Country/Territory | France |
City | Juan les Pins |
Period | 02-12-01 → 02-12-06 |
All Science Journal Classification (ASJC) codes
- General Computer Science